-- Logs begin at Tue 2022-08-30 14:00:27 UTC, end at Tue 2022-08-30 15:12:13 UTC. -- Aug 30 14:35:36.419101 dv-cinder-828806-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 14:35:36.426129 dv-cinder-828806-5-smb devstack@keystone.service[93198]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:35:36 2022] *** Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: nodename: dv-cinder-828806-5-smb Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: machine: x86_64 Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: clock source: unix Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: pcre jit disabled Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: detected number of CPU cores: 4 Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: current working directory: / Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:35:36.429429 dv-cinder-828806-5-smb devstack@keystone.service[93198]: your processes number limit is 47680 Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: your memory page size is 4096 bytes Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: detected max file descriptor number: 2048 Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: lock engine: pthread robust mutexes Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: thunder lock: enabled Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 14:35:36.430181 dv-cinder-828806-5-smb devstack@keystone.service[93198]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:35:36.468673 dv-cinder-828806-5-smb devstack@keystone.service[93198]: Python main interpreter initialized at 0x563e0e2a09c0 Aug 30 14:35:36.468673 dv-cinder-828806-5-smb devstack@keystone.service[93198]: python threads support enabled Aug 30 14:35:36.468673 dv-cinder-828806-5-smb devstack@keystone.service[93198]: your server socket listen backlog is limited to 100 connections Aug 30 14:35:36.468673 dv-cinder-828806-5-smb devstack@keystone.service[93198]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:35:36.469042 dv-cinder-828806-5-smb devstack@keystone.service[93198]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:35:36.469127 dv-cinder-828806-5-smb devstack@keystone.service[93198]: *** Operational MODE: preforking *** Aug 30 14:35:36.469358 dv-cinder-828806-5-smb devstack@keystone.service[93198]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:35:36.469358 dv-cinder-828806-5-smb devstack@keystone.service[93198]: spawned uWSGI master process (pid: 93198) Aug 30 14:35:36.469563 dv-cinder-828806-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 14:35:36.470667 dv-cinder-828806-5-smb devstack@keystone.service[93198]: spawned uWSGI worker 1 (pid: 93212, cores: 1) Aug 30 14:35:36.470667 dv-cinder-828806-5-smb devstack@keystone.service[93198]: spawned uWSGI worker 2 (pid: 93213, cores: 1) Aug 30 14:35:36.470667 dv-cinder-828806-5-smb devstack@keystone.service[93198]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:35:40.801756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:40.801756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: from cryptography.utils import int_from_bytes Aug 30 14:35:40.802840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:40.802840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: from cryptography.utils import int_from_bytes Aug 30 14:35:40.804730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:40.804730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: from cryptography.utils import int_from_bytes Aug 30 14:35:40.805177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:40.805177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: from cryptography.utils import int_from_bytes Aug 30 14:35:40.852948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] command line args: [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ================================================================================ {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] admin_token = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] config_dir = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] config_source = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.858921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] debug = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.859953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:35:40.860020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:35:40.860148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_config_append = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] command line args: [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:35:40.860262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_dir = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:35:40.860434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_file = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ================================================================================ {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:35:40.860559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] admin_token = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] config_dir = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] config_source = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.860975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] debug = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_config_append = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.861938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_dir = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_file = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] publish_errors = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.862975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] standard_threads = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] use_journal = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] use_json = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.863969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] use_stderr = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] use_syslog = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] publish_errors = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.864923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.864989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.865084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.865331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.865448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.865558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.865699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] standard_threads = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.865804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.865938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.866201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.866422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.866641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] use_journal = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] use_json = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.866874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] use_stderr = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.866995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] use_syslog = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.867241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:40.867482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.867981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.868910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.869878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.870952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871075 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.871807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.872944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.873899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.874834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.875951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.876986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.877948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.878996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.879952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.880853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.881905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.882147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.882350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.882431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.887971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.888949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889455 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.889977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.890925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.external = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.password = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.891999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892075 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] auth.token = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.892956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.893902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.external = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.password = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.894958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] auth.token = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.895959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.896991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.897977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.898922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.899920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.900968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.901911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.902941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.903938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.904879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.905993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.906986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907218 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.907937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.908911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.909850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.910005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.910092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.910238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.910316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.910490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.913980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.914948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.915957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.916948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.917948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.918940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.919918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.920903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.921865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] role.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.922887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] role.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.923837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.924965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.925930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.926935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.927093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.927176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.927599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.927706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.927947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.928907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] role.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] role.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.929851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.930851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.931951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.932924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.933957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.934116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.934196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.934352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.934434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.934611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.936950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.connection = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.937899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.938876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.939964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.940585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:35:40.940725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.941007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.941243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.941517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.941791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.942098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.connection = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.942344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.942625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.942907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.943198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.943439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.943680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.943918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.944156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.944403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.944642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.944888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.945123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.945376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.945615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.945863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.946094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.946336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.946601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:40.946773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:35:40.970366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.970621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.970846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.972243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.972479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.972708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.979801 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:40.982001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.011141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.011290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.011373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.011505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.067889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.068925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.122623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.122854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.123184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.123421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.287803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.288980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.289114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.289330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.289544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.312963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.313631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.330481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.331146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.343596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.343829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.344978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.345107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.345322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:35:41.370920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.371129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:35:41.371276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.371469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.371553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:35:41.371667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:35:41.371814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.371939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:35:41.372202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.372805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.373263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.382925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.383971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.384104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.390656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.390953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.393877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.393877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.394117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.394971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.395973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.396105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.396318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.396409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.397173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.419482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.422593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.422696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.422696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.422840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.422840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.425704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.425990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.426274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.426354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.426666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.426963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.433219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.433503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.433728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.434058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.437623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.437916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.438175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.438261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.438478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.438564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.438753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.438880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.439174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.439456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.439746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.440151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.440350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.440702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.440997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.441287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.457139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.457415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.458359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.458666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.461848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.463233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.464965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.465262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.466467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.466759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.469581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.471028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.472706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.474146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.475846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.476145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.476431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.477644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.477644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.477644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.477950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.477950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.478083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.478296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.478617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.478903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.493561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.493843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.494110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.494371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.495627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.495916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.496187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.496467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.501074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.502740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.503342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.506418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.506418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.506759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.507188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.507465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.507923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.508210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.508506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.508802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.509096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.510105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.510401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.510820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.511122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.511425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.520385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.520682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.520968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.521299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.521584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.521866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.522152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.522682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.522978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.523401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.523695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.523979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.524258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.524547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.537410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.540254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.540440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.543175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.543309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.544741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.546141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.546234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.546505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.546933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.547628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.549338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.549626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.549909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.554326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.555838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.557300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.558699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.558809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.558999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.559284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.559558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.561817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.562111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.562397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.562702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.567414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.567703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.567983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.571089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.571344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.571623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.575664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.577858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.578057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.578331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.578572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:35:41.578676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.578859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.578944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.579134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.579207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.579414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.579688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.579963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.580253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.580578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.580827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.581105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.581377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.581639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.581905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.582175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:35:41.612892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e0e2a09c0 pid: 93213 (default app) Aug 30 14:35:41.616866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e0e2a09c0 pid: 93212 (default app) Aug 30 14:35:41.617088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea321b-9d89-49ff-b9cd-046941ec0eef None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:41.617377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea321b-9d89-49ff-b9cd-046941ec0eef None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:41.617653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea321b-9d89-49ff-b9cd-046941ec0eef None None] PATH_INFO: `/v3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:41.621856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Tue Aug 30 14:35:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:49.070337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:49.070868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:49.070952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:49.075170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:49.080424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:49.080865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:49.080958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:49.152399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: INFO dbcounter [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] Registered counter for database keystone Aug 30 14:35:49.171790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG oslo_db.sqlalchemy.engines [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:49.178200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writer thread running {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:49.357624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG passlib.handlers.bcrypt [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93213) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:35:49.357945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG passlib.handlers.bcrypt [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93213) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:35:49.416030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:49.417644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:49.545668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:35:50.004988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:50.075998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: INFO dbcounter [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] Registered counter for database keystone Aug 30 14:35:50.096783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG oslo_db.sqlalchemy.engines [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:50.102973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writer thread running {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:50.221637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bddf43-da9c-49e7-85a5-0b22baf17bd3 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:50.226393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:50.227043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:50.227324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:50.227596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:50.235528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:50.286315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:35:50.287210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a68b-7e6a-47bc-8576-886f06785b30 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:50.296665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Aug 30 14:35:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:35:50.303601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:50.317998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb74dc-578c-4108-b01a-a1d8e9f1d500 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:50.322431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:50.323546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:50.323834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:50.324111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] PATH_INFO: `/v3/projects/fbef91a083854958a533ab27d1be6c95` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:50.325670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] RBAC: Authorizing `identity:get_project(project_id=fbef91a083854958a533ab27d1be6c95)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:50.378542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:35:50.378848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0952ae9-f700-4bba-94b1-f9575e9fbbd1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:50.383451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Tue Aug 30 14:35:50 2022] GET /identity/v3/projects/fbef91a083854958a533ab27d1be6c95 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:52.304220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360923b-7d23-41ac-b723-c625a943026c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:52.304818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360923b-7d23-41ac-b723-c625a943026c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:52.304818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360923b-7d23-41ac-b723-c625a943026c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:52.308861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:35:52.314263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:52.314780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:52.314873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:52.335020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:52.336534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:52.344259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:35:52.625573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360923b-7d23-41ac-b723-c625a943026c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:52.638711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360923b-7d23-41ac-b723-c625a943026c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:52.642938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:52.643541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:52.643829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:52.644104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:52.652179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:52.653937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68567-2651-4cd5-be24-39d47fd40a82 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:52.663538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Aug 30 14:35:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:35:52.668905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:52.678808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5913-77e7-4f8f-9f74-012cd598e34e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:52.683006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:52.683629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:52.683908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:52.684181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:52.685475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:52.687315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f885ed7-7daf-4d59-9483-022dd3f3c2b0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:52.688802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Tue Aug 30 14:35:52 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:54.669743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a45be-d230-4395-b0ff-146e3e38966b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:54.670273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a45be-d230-4395-b0ff-146e3e38966b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:54.670273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a45be-d230-4395-b0ff-146e3e38966b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:54.671691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:54.676737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:54.678010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:54.678266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:54.696493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:54.697661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:54.716908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9147-1fd5-416f-b7a8-25dc963e797d None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:54.717194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9147-1fd5-416f-b7a8-25dc963e797d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:54.717467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9147-1fd5-416f-b7a8-25dc963e797d None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:54.718867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:35:54.723964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:54.724774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:54.725087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:54.767614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG passlib.handlers.bcrypt [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93212) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:35:54.768004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG passlib.handlers.bcrypt [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93212) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:35:54.778158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:35:54.818172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:54.819875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:54.917822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:35:55.048444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.072526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.153103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd44dc-911d-4e97-8416-0a809b226478 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.183187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.185894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.186561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.186842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.187116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.198407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:35:55.206840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:35:55.207961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:35:55.209463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:35:55.214269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.283733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584df7c6-add9-49ee-9ed7-b25e55ff9b59 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.285950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.295046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.312673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb0fc-a737-402d-a741-80a78ea0f5ba None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.320280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.321141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.321431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.321711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.346605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.347219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.347504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.347777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.348457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:35:55.348817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.350714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.362133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:35:55.367719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.389768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.391326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.466360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816b2e-9e6b-4b5b-8936-632db81132fc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.487964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:35:55.493515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.496267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.499087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45919348-d241-4c7c-a498-81857868a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.499717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919348-d241-4c7c-a498-81857868a624 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.500000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919348-d241-4c7c-a498-81857868a624 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.500270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919348-d241-4c7c-a498-81857868a624 None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.501414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45919348-d241-4c7c-a498-81857868a624 None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.502890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45919348-d241-4c7c-a498-81857868a624 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.504499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:35:55.510489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45919348-d241-4c7c-a498-81857868a624 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.525238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.591528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154e814-000d-45e5-959f-2fee86612cb7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.608408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45919348-d241-4c7c-a498-81857868a624 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.624933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.625787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.626067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.626336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.641864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.642515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.642806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.643077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.644171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.645044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.646260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.647148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.647807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:55.653505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:35:55.666193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:35:55.667307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:35:55.668161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:35:55.668161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:35:55.668161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:35:55.668161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:35:55.673039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:55.728978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.741455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:55.760566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e5386-e13f-4dc3-a187-01dd0632899b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.773120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7791a-d00a-42cc-b3c3-65edca2fe5bc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:55.793212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.793826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.794111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.794386 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.795152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.domain.id=default, user.id=0ac9c19be1c04f29b7e3ddf227e2560f) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:35:55.795461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.796885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde708-c023-4c24-a67f-0375f88f0e76 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.804540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/role_assignments?user.id=0ac9c19be1c04f29b7e3ddf227e2560f&scope.domain.id=default&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:35:55.807124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:55.807759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:55.808046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:55.808352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:55.809022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:35:55.809332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:55.810789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25a15-fc99-455e-889d-0c9a32a3cdf6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:55.832716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:35:57.944271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53065-ad8a-4b98-a689-954fed884c25 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:57.945280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53065-ad8a-4b98-a689-954fed884c25 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:57.945769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53065-ad8a-4b98-a689-954fed884c25 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:57.947390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:57.952680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8414-c3ea-4fd5-b83e-f88be2d5a545 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:57.953092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8414-c3ea-4fd5-b83e-f88be2d5a545 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:57.953296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8414-c3ea-4fd5-b83e-f88be2d5a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:57.982724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b2bc8414-c3ea-4fd5-b83e-f88be2d5a545 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:57.983946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b2bc8414-c3ea-4fd5-b83e-f88be2d5a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:58.076754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 11/23] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:35:58.265967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a2a-0722-4573-8343-2acf2c0dd47b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.266664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a2a-0722-4573-8343-2acf2c0dd47b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.267164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a2a-0722-4573-8343-2acf2c0dd47b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.268933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:58.275253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652144-05f3-42b1-be8e-ee2ca141cbd7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.275608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652144-05f3-42b1-be8e-ee2ca141cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.275890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652144-05f3-42b1-be8e-ee2ca141cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.303604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5c652144-05f3-42b1-be8e-ee2ca141cbd7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:58.304801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5c652144-05f3-42b1-be8e-ee2ca141cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:58.357119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:58.389897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 12/25] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:35:58.428727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15016f-70fc-4581-ba8c-d7c4bc3ba379 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.429327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15016f-70fc-4581-ba8c-d7c4bc3ba379 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.429794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15016f-70fc-4581-ba8c-d7c4bc3ba379 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.431355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 14/26] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:58.436679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.437036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.437325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.461815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:58.463055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:58.514582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15016f-70fc-4581-ba8c-d7c4bc3ba379 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:58.552929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:35:58.647619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15016f-70fc-4581-ba8c-d7c4bc3ba379 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:58.689592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:58.690294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.690606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.690880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.705131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:35:58.711100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:35:58.711950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:35:58.712727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 15/28] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:35:58.719300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:58.812202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:58.830373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:58.861711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8da2-4fb0-4e70-ab6f-d54c29203664 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:58.870955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:58.901827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:58.902610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.902902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.903183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.903871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:35:58.904180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:58.905695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eab061-487a-4849-881b-cd9f179432af None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:58.919617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:58.921055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2548-21be-4b38-ad28-d16751ec36a0 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:58.921353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2548-21be-4b38-ad28-d16751ec36a0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:58.921741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2548-21be-4b38-ad28-d16751ec36a0 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:58.923047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 15/30] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:58.928109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc2548-21be-4b38-ad28-d16751ec36a0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.007468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7b8a-9e8f-42c1-a1a7-33de0b1b51df None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.040682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc2548-21be-4b38-ad28-d16751ec36a0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.048631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.049316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.049623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.050278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.063754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.065432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.078003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.078898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.079378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.079811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.081573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-996f46a8-9ef2-40d6-a785-4f2433c08bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:35:59.082823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:35:59.084384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:35:59.085208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:35:59.085208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:35:59.085208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:35:59.085208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 16/31] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:35:59.085874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.086181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.086435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.086720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.088816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 16/32] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:35:58 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:59.089737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.115707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:59.116771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:59.131236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.188379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.198909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1f97-4594-4f1c-9f9b-e78b65d4f366 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.212429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 17/33] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:35:59.213550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.285254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.285879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.286197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.286505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.287195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.288571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.340762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1b2c-2428-489a-8c39-eb8955d2af1a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.375116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.375735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.376043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.376298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.377015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:35:59.377324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.378906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.399079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 18/34] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:59.399697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.495379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.527165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 30 14:35:59 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:35:59.528326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.603188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc03-1165-4f39-a1e4-aa8057fc11ee None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.681152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be498-181a-4a23-b2e3-0f3e85ffd0a2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.682898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.684102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.684620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.685099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.686613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.688372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.689963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.690399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 19/36] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:35:59.697744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.728661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.729314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.729603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.729880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.730602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.732421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.840192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bba309-432a-4cdb-945e-2bb32ede72d8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:59.855032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.860158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:35:59 2022] POST /identity/v3/projects => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:35:59.866508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:59.885447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:59.886544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.887133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.887580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.888513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:59.890578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df91e4-0957-406e-8c9a-5c934f2d059b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:59.995368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b596c-6581-4e35-aed4-ff6bec2167d2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:00.034350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:00.035058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.035344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.035615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] PATH_INFO: `/v3/domains/default/users/0ac9c19be1c04f29b7e3ddf227e2560f/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.039108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0ac9c19be1c04f29b7e3ddf227e2560f, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:00.040555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd808-b4f4-43bd-97ea-5ba7837a9470 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:00.088345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 20/38] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 30 14:35:59 2022] POST /identity/v3/roles => generated 225 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:00.089815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb961fd-d96d-43ab-b770-3723328709f5 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.090114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb961fd-d96d-43ab-b770-3723328709f5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.090400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb961fd-d96d-43ab-b770-3723328709f5 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.091765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 21/39] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:00.092835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7284-02cd-48cb-af32-7007dbcedf16 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.093127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7284-02cd-48cb-af32-7007dbcedf16 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.093412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7284-02cd-48cb-af32-7007dbcedf16 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.094739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 22/40] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:00.097886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.098174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.099132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.120469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:00.121961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:00.142086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 19/41] 10.222.0.47 () {58 vars in 1361 bytes} [Tue Aug 30 14:35:59 2022] PUT /identity/v3/domains/default/users/0ac9c19be1c04f29b7e3ddf227e2560f/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:00.144129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.144427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.146568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.170346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:00.172562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:00.175375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:00.216435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:00.257942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 20/43] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:00.489325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:00.523673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:00.594116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0465ffd-b7f6-4d68-89aa-73fab9221582 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:00.596498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:00.625451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88584-3a82-4442-83c7-a05d468daf97 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:00.635850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:00.636587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.637234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.637571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.638720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:00.640824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f39bf1-0e8e-4e9d-8c5d-9104cdd9d3f3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:00.660421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:00.661615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.661913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.662160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.663368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:00.664903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:00.666436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 21/44] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:00.671909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:00.681026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:00.717323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 24/45] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 30 14:36:00 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:00.781546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92355-00f9-4297-9976-7b3a352a51e5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:00.823085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:00.823851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.824201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.824541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.825286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:00.828257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d38a2-bc6d-43e0-8d99-42fcc5433a43 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:00.900409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 22/46] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:36:00 2022] POST /identity/v3/projects => generated 312 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:02.092707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8112-b5cc-47df-a70e-2bd1489a1b24 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.093207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8112-b5cc-47df-a70e-2bd1489a1b24 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.093207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8112-b5cc-47df-a70e-2bd1489a1b24 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.094546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 25/47] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:02.099832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.100237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.100391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.118701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:02.119880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:02.170420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:02.183808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 23/48] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:02.456363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8112-b5cc-47df-a70e-2bd1489a1b24 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:02.663622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8112-b5cc-47df-a70e-2bd1489a1b24 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:02.697257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:02.697894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.698180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.698467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.708366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ec51a1ee-1bf8-45eb-9413-e118885c6b59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:02.713118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:02.713977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:02.714788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 26/49] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:02.719955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:02.823375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417028f4-c4fe-4b77-b29d-b652b1660e26 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:02.833875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb8de-2482-4bc7-9b84-28731123e1ed None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.834168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb8de-2482-4bc7-9b84-28731123e1ed None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.834475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb8de-2482-4bc7-9b84-28731123e1ed None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.835893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 27/50] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:02.841654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.841944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.842226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.863612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:02.865350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:02.886019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:02.938926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 28/51] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:02.963880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:02.964435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.964751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.965034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.965711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:02.966024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:02.967454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:02.976053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 24/52] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:02.981510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.077503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2f6e-cd9c-4da5-b5ac-125841bc96a8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.110177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.110827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.111109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.111386 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.112508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.113991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.116268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 29/53] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:02 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:03.121729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.170848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:03.209200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.219891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8877a2-d397-4bbb-bac0-d2c402c95ce3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.233592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:03.252777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.253409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.253690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.253965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.255105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.256604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.258148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 25/54] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:03.264039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.309646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98887087-9dd9-450a-8521-5bb3a18b5b0c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.342623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.343254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.343536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.343809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.344901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.346468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.348028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 30/55] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:03.354265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.364115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663eadc-9d9f-488c-a8a5-ee1f16047012 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.380969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:03.397421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.398038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.398322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.398625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.399357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.domain.id=default, user.id=0ac9c19be1c04f29b7e3ddf227e2560f) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:03.399665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.401129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c41e4-205f-48c4-9fec-f612ccd39f5c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.409705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 26/56] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Aug 30 14:36:03 2022] GET /identity/v3/role_assignments?user.id=0ac9c19be1c04f29b7e3ddf227e2560f&scope.domain.id=default&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:03.453466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:03.464395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c2a8e-25ff-4179-adad-f360fc89f56b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.500927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.501556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.501841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.502116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.502817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.504320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47da790-c3f5-4297-ae99-8d4c457ea629 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.588841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 31/57] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Aug 30 14:36:03 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:05.483540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9b2f-0341-46d5-8744-1e01d0dfcd50 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:05.484054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9b2f-0341-46d5-8744-1e01d0dfcd50 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:05.484135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9b2f-0341-46d5-8744-1e01d0dfcd50 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:05.485447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 27/58] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:05.490969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:05.491363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:05.491540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:05.510280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:05.511530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:05.580520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 32/59] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:05.852322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9b2f-0341-46d5-8744-1e01d0dfcd50 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:05.954176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9b2f-0341-46d5-8744-1e01d0dfcd50 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:05.987522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:05.988151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:05.988436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:05.988715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:05.990946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:05.992400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed1fc0-2547-4111-90df-efd20db1a15f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:05.993933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 28/60] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:05.999318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:06.067813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:06.095425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8c44-5643-4b3a-b2a5-670a6cc89cca None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:06.129222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:06.130302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:06.130621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:06.130901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:06.131568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:06.133005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb080-5221-4881-894d-550ac960c02c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:06.240697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 33/61] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:05 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:09.125898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ffe7-7544-465e-93c8-7cb2c90f24a6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.125898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ffe7-7544-465e-93c8-7cb2c90f24a6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.125898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ffe7-7544-465e-93c8-7cb2c90f24a6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.126855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 29/62] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:09.131275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2ca0-cd86-4cee-bf4f-079d978fcd53 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.132086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2ca0-cd86-4cee-bf4f-079d978fcd53 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.132666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2ca0-cd86-4cee-bf4f-079d978fcd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.159460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c76b2ca0-cd86-4cee-bf4f-079d978fcd53 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:09.161484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c76b2ca0-cd86-4cee-bf4f-079d978fcd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:09.254986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 34/63] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:09.367837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc7c3-27f2-4ae3-bcc4-791af363d482 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.368495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc7c3-27f2-4ae3-bcc4-791af363d482 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.368972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc7c3-27f2-4ae3-bcc4-791af363d482 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.370783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 30/64] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:09.375562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5798e0-a528-4525-8e15-08d40a789993 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.376126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5798e0-a528-4525-8e15-08d40a789993 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.376606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5798e0-a528-4525-8e15-08d40a789993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.403420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cf5798e0-a528-4525-8e15-08d40a789993 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:09.404951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cf5798e0-a528-4525-8e15-08d40a789993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:09.474141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:09.499783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 35/65] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:09.530311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5522d-b7c3-45af-b421-01cd0f350ac6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.530993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5522d-b7c3-45af-b421-01cd0f350ac6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.531473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5522d-b7c3-45af-b421-01cd0f350ac6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.533295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 31/66] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:09.540033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b1b0-7158-4063-b62a-d811bf9db03e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.540339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b1b0-7158-4063-b62a-d811bf9db03e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.540627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b1b0-7158-4063-b62a-d811bf9db03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.568493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2609b1b0-7158-4063-b62a-d811bf9db03e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:09.569709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2609b1b0-7158-4063-b62a-d811bf9db03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:09.608796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5522d-b7c3-45af-b421-01cd0f350ac6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:09.662037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 36/67] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:09.701430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:09.775762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5522d-b7c3-45af-b421-01cd0f350ac6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:09.799381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225d0-6dc9-48fb-ba03-4db3ebda8abc None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.799990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225d0-6dc9-48fb-ba03-4db3ebda8abc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.800472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225d0-6dc9-48fb-ba03-4db3ebda8abc None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.802651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 37/68] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:09.816810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.817388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.817866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.835368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:09.836238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.836673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.837098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.847194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:09.849456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:09.849812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:09.856495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:09.857379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 32/69] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:09.858613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:09.946019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 38/70] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:09.946019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:09.983821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee4d0-dc9e-4185-997c-c883b2b9b112 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:09.995953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.002148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.021763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.022664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.023093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.023544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.034817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:10.042228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:10.043346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:10.044273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:10.046087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 33/71] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:10.047058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.060418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b98399-84d7-463a-a9c5-ac81f72f72b0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.098648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.099297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.099582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.099861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.100555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:10.101012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.102859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.113632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 39/72] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.114604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.161519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5605-9692-49dd-9d70-60ba9a2f3e1f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.199300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.200252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.200756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.201247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.214645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:10.220034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:10.220910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:10.221678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 34/73] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:10.222327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.241361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01214aa-feee-464f-a889-5ed3414cc49a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.251770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.252548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.275221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.275841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.276130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.276412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.277094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:10.277404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.278823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d511a83-5909-458d-ac28-1afc63e1f62d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.287683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 40/74] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.288936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec34a-175c-498f-9f41-aaebc51646b0 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.289234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec34a-175c-498f-9f41-aaebc51646b0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.289519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec34a-175c-498f-9f41-aaebc51646b0 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.290931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 41/75] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:10.291528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bec34a-175c-498f-9f41-aaebc51646b0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.323635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268626-3be7-45a2-a5fb-e88f317f0489 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.358211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.358873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.359158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.359438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.374275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.375764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.377371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 35/76] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.378148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.397276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bec34a-175c-498f-9f41-aaebc51646b0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.429640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.430270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.430584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.430860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.440853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ca11b0ff-128f-47a0-a7b3-e03a984ea59f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:10.446869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:10.447752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:10.448542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 42/77] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:10.449739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.449739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.449739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.467233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:10.467554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.468439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:10.479613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9efe-f525-4b0a-ba76-bb61e1a56aad None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.494883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.513444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.514062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.514349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.514706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.515378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:10.515687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.517054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.524965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 36/78] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.525763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.540387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 43/79] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:10.548174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.628893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96102e77-32d2-4472-9a83-7f8ad1895040 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.651941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04ff3-7188-4abe-b5f7-e7b7fbba539b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.662340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.663003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.663296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.663579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.664739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.666181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.667925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 37/80] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.668610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.693137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.695857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.696488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.696776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.697055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.728738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.766364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.767873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.779257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec455f7-6bf2-4505-b1a1-41306cd992db None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.815320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.816034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.816394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.816704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.817389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:10.817705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.819129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.827338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 38/81] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.828062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.874292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 44/82] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:10.875202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:10.915757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.934226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f0bf-2d54-4fa5-8b20-b4d0deac5fef None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.936816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:10.967656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:10.968299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:10.968589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:10.968876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:10.970021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:10.971501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:10.973680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 39/83] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:10.978831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfab5-cd92-4d91-a4ea-209801dcf1e4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:10.978954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.009124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.009739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.010029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.010317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.070722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1bdee-a6c5-4442-9082-19709977117b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.076524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.077982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.105100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.105731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.106017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.106294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.107445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.108882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.110426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 40/84] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:11.111271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.128842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.141352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.180010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 45/85] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:11.181097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.215181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395450-19a5-4c32-90e9-b86c948ca399 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.247811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.248444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.248724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.248997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.250132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.251616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.253172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 41/86] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:11.253930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.283543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd22775-4ae5-47c8-9c79-07b090e64cc5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.317804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.318472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.318766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.319049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.320207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.321672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.323359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 46/87] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:11.323359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.338078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.353398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db302b5-cf70-43f3-89cf-1c00b89f420e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.356806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.387323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.387931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.388217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.388496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.424436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331221e-8f62-4045-8c1c-9adae466ebe0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.453904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.455396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.458103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.458747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.459034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.459311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.459969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.461408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.534963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.550760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 42/88] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:11.551974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.635221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 47/89] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:11 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:11.636321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.655906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc2c5-80bd-4faa-9a66-f4e060425faf None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.695035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.695689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.695979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.696262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.697528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.699040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.700770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 43/90] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:11.706012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.752327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.765318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.769182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4c22e-cfcf-4769-b747-56438a44363e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.809626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.810185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.810993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.811296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.822686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ba95-1966-4f62-8b5c-5a0211f67b47 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.867106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.867742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.868033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.868317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.869495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:11.869495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.871620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.878116 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 44/91] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:11.879018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.900641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.902549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.016259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624632-4b90-4985-8e3b-3e1ae1b73c8d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:12.028694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:12.035154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:12.044511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 48/92] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:12.054597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:12.060508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:12.061147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:12.061435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:12.061709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:12.062890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:12.064328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.066002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 45/93] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:12.067172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:12.218673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd640-589e-4d51-bed4-17bc8ee2f5dc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:12.238025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914020c-1634-4447-9303-7d4ff5eef115 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:12.275526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:12.276217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:12.276515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:12.276797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:12.277556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=0ac9c19be1c04f29b7e3ddf227e2560f) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:12.277875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:12.279375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.285430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 49/94] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:12 2022] GET /identity/v3/role_assignments?user.id=0ac9c19be1c04f29b7e3ddf227e2560f&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:12.287026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:12.307903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:12.308576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:12.308862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:12.309137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] PATH_INFO: `/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:12.310288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] RBAC: Authorizing `identity:get_project(project_id=8274f1887b0f4ee39888ff0f1b8988ae)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:12.311847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.313821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 46/95] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:12 2022] GET /identity/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:12.336916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:12.362832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:12.404611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a790-c9d4-4d77-a690-5ce42a4029e2 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:12.442770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:12.443555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:12.443860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:12.444152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:12.444927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:12.445254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:12.446944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a022-bc25-4ae3-818d-8c4b9bac611f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.447943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:12.453608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 50/96] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:12 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:12.532410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d39ab-c83e-4a55-86c9-65991bee829f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:12.586852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:12.586852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:12.586852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:12.586852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:12.587225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=8274f1887b0f4ee39888ff0f1b8988ae, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:12.587225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:12.588183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe71cc-e8de-47d4-896e-aa50fe657e2b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:12.595776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 47/97] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:12 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=8274f1887b0f4ee39888ff0f1b8988ae&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:13.976990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ee3d-9b6d-42cb-8fba-d812997de8df None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:13.977488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ee3d-9b6d-42cb-8fba-d812997de8df None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:13.977559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ee3d-9b6d-42cb-8fba-d812997de8df None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:13.979103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 51/98] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:13.984554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fbf3-7e53-4214-97ff-7f8c379773e6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:13.984952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fbf3-7e53-4214-97ff-7f8c379773e6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:13.985118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fbf3-7e53-4214-97ff-7f8c379773e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.011476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-7277fbf3-7e53-4214-97ff-7f8c379773e6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:14.012677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7277fbf3-7e53-4214-97ff-7f8c379773e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:14.099415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:14.577445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df0c6-0c3c-4bfd-aab5-3e36ef7cf13a None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.577805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df0c6-0c3c-4bfd-aab5-3e36ef7cf13a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.578006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df0c6-0c3c-4bfd-aab5-3e36ef7cf13a None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.579503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 52/100] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:14.584876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943a2f-d718-4fe1-b2f8-ddeb3fb9c8c6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.593306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943a2f-d718-4fe1-b2f8-ddeb3fb9c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.593306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943a2f-d718-4fe1-b2f8-ddeb3fb9c8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.608990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1f943a2f-d718-4fe1-b2f8-ddeb3fb9c8c6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:14.609148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df0c6-0c3c-4bfd-aab5-3e36ef7cf13a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:14.610537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1f943a2f-d718-4fe1-b2f8-ddeb3fb9c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:14.677497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:14.743274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 49/101] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:14.762688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df0c6-0c3c-4bfd-aab5-3e36ef7cf13a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:14.775897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef071-92d3-4147-a757-ddd8851991bc None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.776451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef071-92d3-4147-a757-ddd8851991bc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.776931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef071-92d3-4147-a757-ddd8851991bc None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.778838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 50/102] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:14.783279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.783754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.784203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.802811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:14.821182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:14.822380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:14.849931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:14.850619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.851636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.851923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.853209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:14.854701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:14.856434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 53/103] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:14.862927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:14.924963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:14.997363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3915-30da-4685-9c81-3e8e09c57899 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.047495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.048123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.048410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.048687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.049339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:15.051516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:15.151608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 54/105] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:36:14 2022] POST /identity/v3/projects => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:15.280113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:15.379211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:15.401522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5718-5621-4435-8a9d-802eeb9193b2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.409713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:15.441426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:15.451334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.452310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.452751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.453646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.468057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-4dc78bbb-688b-473c-8766-3581ef754b6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:15.474839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:15.475679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:15.476477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:15.479879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 52/106] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:15.482001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af403d-5e3c-4d2c-9426-0e271b498932 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.482676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af403d-5e3c-4d2c-9426-0e271b498932 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.483152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af403d-5e3c-4d2c-9426-0e271b498932 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.485331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 53/107] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:15.486466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af403d-5e3c-4d2c-9426-0e271b498932 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:15.539272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce8ec-0864-414a-9b7a-42b81f7fdef7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.584195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.585158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.585628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.586062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.597166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-116d27bc-d6de-4fa9-9644-f75933cb745a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:15.602946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:15.603898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:15.604653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:15.606997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 55/108] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:15.608407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.608892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.609362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.617875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af403d-5e3c-4d2c-9426-0e271b498932 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.629083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:15.631165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:15.659408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.660985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.661235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.661513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.662355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:15.662775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:15.664330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefbd2b-90a2-4ff8-8d9a-3cd434b87170 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:15.677796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 54/109] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:15.679671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4010d-08d2-498b-81e2-de1a304b374f None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.679968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4010d-08d2-498b-81e2-de1a304b374f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.680246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4010d-08d2-498b-81e2-de1a304b374f None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.681791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 55/110] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:15.686566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4010d-08d2-498b-81e2-de1a304b374f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:15.713342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 56/111] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:15.714552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:15.726611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:15.750349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:15.836599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4010d-08d2-498b-81e2-de1a304b374f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.843629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e571b4-9c78-4d01-a3e4-152afd0cfbc3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.881854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.882496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.882894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.883172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.883956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:15.884263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:15.885625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c2a6-25b1-45e9-805c-0cd5d5ee424b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:15.892305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.893209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.893696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.894153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] PATH_INFO: `/v3/users/e984244789e144dda07985a5bf7fdea1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.894699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 56/112] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:15.896237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.896524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.896800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.913829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] RBAC: Authorizing `identity:get_user(user_id=e984244789e144dda07985a5bf7fdea1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:15.915251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3154-caee-4c96-b658-3e1a22820f12 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:15.915861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:15.917059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:15.917306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 57/113] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/users/e984244789e144dda07985a5bf7fdea1 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:15.918651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ff8d-6886-4bd1-afb3-612680cf46bd None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.919193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ff8d-6886-4bd1-afb3-612680cf46bd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.919485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ff8d-6886-4bd1-afb3-612680cf46bd None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.921608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 58/114] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:15.922386 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840ff8d-6886-4bd1-afb3-612680cf46bd None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.033375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:16.034533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.038724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.062043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840ff8d-6886-4bd1-afb3-612680cf46bd None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.069274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.113134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.114308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.114851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.115329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.116683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.118362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01244221-0820-4316-b886-402a7ef5f2a3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.120237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 59/116] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:15 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.121551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.122040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.122552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.141088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:16.142711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:16.171195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0ba3-6c6d-49c4-b996-40d43617abc4 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.208797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.209907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.210497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.210974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.225688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 60/117] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:16.227036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.298822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.300297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.321017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.329462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.346177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc8f1-e813-4bdc-83f4-33bd6ac789ed None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.393264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.393907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.394193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.395333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.410003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:16.416490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:16.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:16.418123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 61/118] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:16.418805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 58/119] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:16.418874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.419639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.538837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccce7b-4989-4f60-af48-c54412827b9b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.539384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516873ec-f8ee-49bb-9b54-095941090a88 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.564145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.579035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.579670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.579953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.580230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.586519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.587470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.588157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.588582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.590127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.590605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:16.591920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.593782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 62/120] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.594761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:16.595959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:16.596998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 59/121] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:16.598789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.611239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.731419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f979-e65f-4d90-837d-f819b582050c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.733491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4ce87-79e0-4e0f-9e0c-6cc62409dab1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.767874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.768687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.769120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.769469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.770180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:16.770599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.771979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.772793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.773435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.773725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.774252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.775241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.776756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.778405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 63/122] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.779202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.789740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 60/123] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.789740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.833616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.871784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:16.894235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ec7ca-a48b-48d4-aafc-bd8d03d57d05 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.898808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8be2b-26c1-4958-b862-0467cb986b43 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:16.930023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.930661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.930949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.931227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.931969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:16.932199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:16.933577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:16.938601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:16.939555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.939841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.940129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.947339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 61/124] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.947339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:16.952336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:16.958076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:16.959044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:16.959810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:16.965581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 64/125] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:16.966307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.055721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d8d9-f3c2-488a-9a61-86df3b5d2a77 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.057947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.078371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17681807-4d7e-44b4-864f-93533fa22f0d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.091995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.093333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.094058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.094346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/3d538553d7de4705bdde974f0e9254ef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.096474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, user_id=3d538553d7de4705bdde974f0e9254ef, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.098005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.113903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.114517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.114809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.118967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.118967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=e984244789e144dda07985a5bf7fdea1) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:17.118967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.118967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.120643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.123355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 65/126] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:16 2022] GET /identity/v3/role_assignments?user.id=e984244789e144dda07985a5bf7fdea1&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=c937b50f403345129308873cb7c1ee19 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.124131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.201849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 62/127] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:16 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/3d538553d7de4705bdde974f0e9254ef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:17.203662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.259395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947a0f4-a12b-4fac-abde-d3bbb2d9165c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.333238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.334262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.334775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.335463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.337383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.340344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.343559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 66/128] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.344617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.403049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d7fe-bcf1-4ac1-a6cb-b2f5218b6fba None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.429307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.442598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.445259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.445259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.445259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.446904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.448064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.449821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 63/129] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.454826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.466458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c6bd2-bfbc-4468-a53b-acd55b03704f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.497096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.504625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.519314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2a8e-9efa-4c36-b9fb-8f189359e45f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.520381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 67/130] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.520381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62552b9-7d23-4667-8e7a-ccb5a7ff92d8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.520381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62552b9-7d23-4667-8e7a-ccb5a7ff92d8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.520381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62552b9-7d23-4667-8e7a-ccb5a7ff92d8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.521679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 68/131] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:17.522543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62552b9-7d23-4667-8e7a-ccb5a7ff92d8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.595203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a520db7-c36b-4342-828e-9d6a5aee99c0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.632651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.633705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.634246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.634685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] PATH_INFO: `/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.635990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] RBAC: Authorizing `identity:get_project(project_id=8274f1887b0f4ee39888ff0f1b8988ae)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.637570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2582e-feb6-4c03-823e-e2540d7676cc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.637919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62552b9-7d23-4667-8e7a-ccb5a7ff92d8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.639714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 64/132] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.641167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.641711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.642210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.662668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:17.664336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:17.669872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.676501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.677467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.677777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.678045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.679292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.680759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.682593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 69/133] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.683283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.741230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 65/134] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:17.742075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.778811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:17.845646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aab33-d060-41e1-b0dd-206d7ed99656 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.851646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01c77-53d1-482f-8055-cefe26ea3149 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.916408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.917323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.918602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.919335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.919808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.920601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.921885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.922485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.922923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] PATH_INFO: `/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae/users/3d538553d7de4705bdde974f0e9254ef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.924186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.925171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8274f1887b0f4ee39888ff0f1b8988ae, user_id=3d538553d7de4705bdde974f0e9254ef, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.926779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 70/135] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:17.927789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.927901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:18.008569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:18.049469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 66/136] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:17 2022] PUT /identity/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae/users/3d538553d7de4705bdde974f0e9254ef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:18.051751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:18.056474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c3fc3-d3d6-4713-beb7-57e9e29f1705 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:18.138547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:18.140030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:18.140477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:18.140896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/3d538553d7de4705bdde974f0e9254ef/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:18.144848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, user_id=3d538553d7de4705bdde974f0e9254ef, role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.151441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.210766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:18.224009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8dc2-6164-4e7e-81a2-f541ae4a5fd8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:18.259560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:18.260215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:18.260499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:18.260776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:18.261900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.263375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.265153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 67/137] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:18 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:18.265777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:18.276817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 71/138] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:17 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/3d538553d7de4705bdde974f0e9254ef/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:18.277485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:18.394371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087f73e-1612-43e9-9cd6-7cb074a5558b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:18.454290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:18.454959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:18.455239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:18.455530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:18.458366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.460946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.462842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 68/139] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:18.469165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:18.495864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e412c-0db2-436a-9d70-25612868ab1d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:18.526426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:18.556279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:18.576336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:18.577131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:18.577478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:18.577835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/0ac9c19be1c04f29b7e3ddf227e2560f/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:18.581033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, user_id=0ac9c19be1c04f29b7e3ddf227e2560f, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.582912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b02c-cebc-41a6-8623-861cef31da2f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.639434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb15a-7fa8-4af5-a85d-a391aed559b2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:18.680740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:18.681295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:18.681584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:18.681865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:18.683024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.686481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbec2cc-6061-4a6d-bf51-b03dceabc26b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.686812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 72/140] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:18 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/0ac9c19be1c04f29b7e3ddf227e2560f/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:18.813501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 69/141] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:18 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:19.381583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5daa-05c3-4cc4-84f4-b13e9cec23cc None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.382645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5daa-05c3-4cc4-84f4-b13e9cec23cc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.383137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5daa-05c3-4cc4-84f4-b13e9cec23cc None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.384678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 73/142] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:19.390002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156173-7dc8-409a-8221-8034ba0a4268 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.390306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156173-7dc8-409a-8221-8034ba0a4268 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.390611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156173-7dc8-409a-8221-8034ba0a4268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.419545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f8156173-7dc8-409a-8221-8034ba0a4268 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:19.420777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f8156173-7dc8-409a-8221-8034ba0a4268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:19.500511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 70/143] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:19.570214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb240-93a8-4784-96d1-cbfb0e36da43 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.570615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb240-93a8-4784-96d1-cbfb0e36da43 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.571002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb240-93a8-4784-96d1-cbfb0e36da43 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.573058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 74/144] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:19.587734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.588040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.588916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.613007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:19.615267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:19.623901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:19.696424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 71/145] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:20.015354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fb240-93a8-4784-96d1-cbfb0e36da43 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.029206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.158568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b06bf8-4dff-4f09-b3be-832abff75508 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.198515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.199160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.199443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.199716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.211553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:20.216759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:20.217634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:20.218397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 72/146] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:20.225284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.229052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.259718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fb240-93a8-4784-96d1-cbfb0e36da43 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.329964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.330574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.330858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.331130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.340416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885b71-7e40-4bda-8051-b1408c57c659 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.355332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:20.360769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:20.361624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:20.362405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 75/147] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:20.371454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.381311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.381943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.382217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.382506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.383184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:20.383539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.384942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.393942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 73/148] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:20.399650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.438823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.467405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.512223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c940a-7ec6-43ac-9571-46d48a386dd6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.516446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bdb4-4340-4735-a0fa-d9f6caad6c88 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.559214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.559834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.560116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.560389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.561195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:20.561489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.563345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.572559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.573210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.573495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.573770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] PATH_INFO: `/v3/users/e984244789e144dda07985a5bf7fdea1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.575064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] RBAC: Authorizing `identity:get_user(user_id=e984244789e144dda07985a5bf7fdea1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.576555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.578301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 74/149] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/users/e984244789e144dda07985a5bf7fdea1 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:20.580592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 76/150] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:20.585003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.596848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.749243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31b9db-f64c-430a-b991-2b24d3d7fdd5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.760315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.793264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.793926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.794214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.794523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.799436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.801903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.804563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390150-af34-4f22-a4a9-2a8ca9894d72 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.807566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 77/151] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:20.818383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.879598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.886233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.895204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 75/152] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:20.907318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:21.007701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d2dc-f615-45eb-8a68-e5234714f3d5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:21.073768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:21.074426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.074796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.075073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.104530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c290d-5603-4116-96dd-18401b7eca50 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:21.156725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:21.157407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.157683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.157957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/e984244789e144dda07985a5bf7fdea1/roles/c937b50f403345129308873cb7c1ee19` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.159138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:21.161668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, user_id=e984244789e144dda07985a5bf7fdea1, role_id=c937b50f403345129308873cb7c1ee19)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:21.163149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57cf78-f564-40ac-95ab-28831f2008eb None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:21.189864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:21.191515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:21.263609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 76/153] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:20 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/users/e984244789e144dda07985a5bf7fdea1/roles/c937b50f403345129308873cb7c1ee19 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:21.264964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8903a-e1f5-4ffb-af0c-cb117625cdae None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.265253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8903a-e1f5-4ffb-af0c-cb117625cdae None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.265529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8903a-e1f5-4ffb-af0c-cb117625cdae None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.271930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 77/154] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:21.278187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.278512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.278854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.314960 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:21.316254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:21.318105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 78/155] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:21.323891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:21.402650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:21.418338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 78/156] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:21.430715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:21.463719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad15791-9b28-407d-9e89-656d863ca123 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:21.507898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:21.508565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.508831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.509104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.510251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:21.511728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a81856-f288-4e64-be54-905d026218c7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:21.513507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 79/157] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:21 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:21.520250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:21.649631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4f9b-3106-4dab-bef0-94a8ce593252 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:21.686470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:21.687421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.687957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.688421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.689345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:21.689849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:21.692040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba142-14c8-4205-bf4f-2430707eefac None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:21.698543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 79/158] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:21 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:21.767356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5625-526a-4806-bad8-6f46a5ccf384 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.767664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5625-526a-4806-bad8-6f46a5ccf384 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.767920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5625-526a-4806-bad8-6f46a5ccf384 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.769635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 80/159] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:21.775255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:21.775845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:21.776313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:21.802230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:21.803843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:21.865516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:21.888538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 80/160] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:22.046827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5625-526a-4806-bad8-6f46a5ccf384 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.170028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5625-526a-4806-bad8-6f46a5ccf384 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.218534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.219435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.219853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.220261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.235489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8dc5aa27-3860-4f3b-8289-59c01a0048c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:22.240764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:22.241779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:22.242824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:22.244648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 81/161] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:22.250688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.338730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94852f00-b635-4743-bee0-ec2049a51927 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.339222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94852f00-b635-4743-bee0-ec2049a51927 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.339636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94852f00-b635-4743-bee0-ec2049a51927 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.341162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 82/162] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:22.355797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.356298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.356711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.367136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.388231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1b93-5036-4599-9e09-5f5dc463cef2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.389677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:22.392251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:22.452731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.453361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.453641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.453912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.454686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:22.454989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:22.456385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:22.478992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 81/163] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:22.479857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.547198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.579786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 83/164] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:22.580683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.637154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e08b39-0ad5-4e8b-bc9c-3c3ad0faa7d8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.723579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.724293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.724581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.724859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.733866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9bdbf-ab9c-4322-bca1-292097e5e5be None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.755675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:22.767185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:22.768050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:22.768903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 82/165] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:22.774390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.789547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.790197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.790509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.790790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.793483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:22.795045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:22.796642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 84/166] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:22.808341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.814763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.918191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9222d1-5f15-44b9-a24b-7507679b0345 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.925261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.979161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.979789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.980103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.980399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.981111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:22.981415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:22.982878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:22.989653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a77a-3b79-4d02-a020-0c6409391035 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.997971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 83/167] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:22.999109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.067315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.068246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.068705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.069130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.154472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287c3e-0719-4603-ac74-27a1cac59525 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.205555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.206106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.206383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.206734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] PATH_INFO: `/v3/users/3d538553d7de4705bdde974f0e9254ef` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.208416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] RBAC: Authorizing `identity:get_user(user_id=3d538553d7de4705bdde974f0e9254ef)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.209867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.211467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 84/168] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/users/3d538553d7de4705bdde974f0e9254ef => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:23.228753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.230275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.231430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.232277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.294863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.384085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b25156-8608-454b-adca-6b34bdfc5a22 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.390893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 85/169] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:36:23.391415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.456463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.457336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.457762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.458040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.592354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978569-42e2-4999-9560-9fe643e0f660 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.594972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.615345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.617379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.660411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.661616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.662110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.662614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.687473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:23.687757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:23.694495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:23.700939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 86/170] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:23.701773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.836488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 85/171] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:23.837371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.887663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a501-c69a-4fe8-bd91-9e606682915f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.927614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.928516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.928963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.929387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] PATH_INFO: `/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.930709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8274f1887b0f4ee39888ff0f1b8988ae)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.932310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c010cf-e718-4dce-bde6-9971fcefa6c8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.934089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 87/172] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/projects/8274f1887b0f4ee39888ff0f1b8988ae => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:23.935404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157166-cd5e-4977-8ce5-d256ae99dfb1 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.935865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157166-cd5e-4977-8ce5-d256ae99dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.936136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157166-cd5e-4977-8ce5-d256ae99dfb1 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.937713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 88/173] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:23.943604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0157166-cd5e-4977-8ce5-d256ae99dfb1 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.949816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848ef5-e8c0-4b29-8ffe-029125e230d5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.976338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.989611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.990634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.991208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.003050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.003050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:24.003050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.003050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5f17-0517-4d9e-969f-d3f720ba4572 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.003050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.005338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 86/174] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:24.007017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587278-15d2-449a-b82f-9bcc537614d1 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.007505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587278-15d2-449a-b82f-9bcc537614d1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.007967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587278-15d2-449a-b82f-9bcc537614d1 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.009631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 87/175] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:24.015103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.015612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.016209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.037058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:24.038890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:24.055235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0157166-cd5e-4977-8ce5-d256ae99dfb1 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.093351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.093979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.094368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.094676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.095909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.097396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.099545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 89/176] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:24.100322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.114104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 88/177] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:24.114916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.222337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e7e8-7f17-4af3-a4e6-1a0f93aae0a6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.230077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.234762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6948e-2a83-4524-828f-909d7dac7cc9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.251241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.259516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.260164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.260450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.260728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] PATH_INFO: `/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.261861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] RBAC: Authorizing `identity:get_user(user_id=0ac9c19be1c04f29b7e3ddf227e2560f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.263340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25aaa-e53c-4c54-8422-54812058012f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.269899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 89/178] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/users/0ac9c19be1c04f29b7e3ddf227e2560f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:24.271247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd293-6abb-4f71-9ad9-9983679305ac None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.271537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd293-6abb-4f71-9ad9-9983679305ac None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.271817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd293-6abb-4f71-9ad9-9983679305ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.275558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.276439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.276935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.277492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.278435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=8274f1887b0f4ee39888ff0f1b8988ae, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:24.279083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.280741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.287352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 90/179] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=8274f1887b0f4ee39888ff0f1b8988ae&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:24.288980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.290313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-977bd293-6abb-4f71-9ad9-9983679305ac None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:24.291663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-977bd293-6abb-4f71-9ad9-9983679305ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:24.370556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 90/180] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:24.370556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537557-f703-42af-a387-68b6fe880aa1 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.370556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537557-f703-42af-a387-68b6fe880aa1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.370556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537557-f703-42af-a387-68b6fe880aa1 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.370556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 91/181] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:24.370988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d537557-f703-42af-a387-68b6fe880aa1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.443242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f45d9-2197-46a1-bcf4-10059cb7897b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.500250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.500883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.501172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.501454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.502203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=3d538553d7de4705bdde974f0e9254ef) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:24.502903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.504630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf6b15-413a-4c2b-8489-818632ac42fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.511366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 91/182] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/role_assignments?user.id=3d538553d7de4705bdde974f0e9254ef&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:24.512573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.519139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.519427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.544555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d537557-f703-42af-a387-68b6fe880aa1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.547320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:24.548790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:24.577774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.588077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.601855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.602861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.603353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.603810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.641864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 92/183] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:24.642580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.756567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:24.758222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:24.780358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d0a9a-66a7-4843-902b-01bb26ca7d4b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.835464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:24.836124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.836563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.836844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.849552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-1f74b97e-cf36-499e-80ff-b0b19e1c6cca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:24.854400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:24.855308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:24.856081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 93/184] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:24.863776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d7e4-e60d-4198-a6ee-161e40d265da None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:24.863776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d7e4-e60d-4198-a6ee-161e40d265da None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:24.863776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d7e4-e60d-4198-a6ee-161e40d265da None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:24.863776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 94/185] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:24.863776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d7e4-e60d-4198-a6ee-161e40d265da None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.879154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.897422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 92/186] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:24.897422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:24.922767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:24.970455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d7e4-e60d-4198-a6ee-161e40d265da None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:24.996029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009ff2-7872-4eba-b2bc-b792714f86ab None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.003973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.004601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.004880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.005156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.014857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-e23859ae-9377-4397-a561-c12073bbefc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:25.020139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:25.021086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:25.021905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 95/187] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:25.022625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.022625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.022902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.037405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.038021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.038304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.038618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.039276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:25.039580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.040404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:25.040936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.041621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:25.048926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 93/188] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.049708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.108977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 96/189] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:25.110063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.123751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.138251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.150516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af99f-3a02-4ffa-b384-c6a0f70e17a4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.187512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.188513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.188806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.189087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.190572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.192135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.193773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 94/190] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.194559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.216504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993546c-61ed-421a-8546-9063fd87ae91 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.250136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.250798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.251085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.251363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.252471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.254283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.256192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 97/191] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.256961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.298849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862c707-d017-49ff-9389-b5606f475291 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.334639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.335252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.335540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.335806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.336482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:25.336788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.338170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.342366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.346851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 95/192] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.348321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.372322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d732-8c44-44c5-b98f-eac759121a0b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.372861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.406427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.407017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.407325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.407596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.421110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.422583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.424185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 98/193] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.424928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.451952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6fe5-2d35-49af-9c90-4d07e376191f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.484457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.485067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.485352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.485629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.486360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=0ac9c19be1c04f29b7e3ddf227e2560f) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:25.486710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.488773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.494772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 96/194] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/role_assignments?user.id=0ac9c19be1c04f29b7e3ddf227e2560f&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.495679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.527360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d45fc-57b0-43a2-bf90-e2dc9f7ec03f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.563748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.569713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.570608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.570608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.570924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.571645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.573052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.589063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.608113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97482aa5-01ba-4037-a569-8009856fdd85 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.645075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.645794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.646087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.646359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.647554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.649000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:25.651415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 97/195] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:25.652358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.715384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 99/196] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:25 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:25.716304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.759797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478299b5-fa53-4535-8d5b-3ae7d50225d5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.799152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.799810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.800090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.800401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.812327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:25.818255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:25.819425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:25.820229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 98/197] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:25.820895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:25.838070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.844118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8f39-ba4a-404d-9975-50915f8d23d7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.884993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:25.885734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.886020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.886295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.951544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba8c-7acc-4622-be15-d8a8cd206534 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:25.955674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.971141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:25.974258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.000391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.002155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.002155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.002155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.098074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.099778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.101092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 100/198] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:26.102305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.112163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.212239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.225668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b438-e664-4e2e-882c-21163ab963b1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.231000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 99/199] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:26.231781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.276872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.277491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.277771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.278044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.278752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:26.279061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.280435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.289478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 101/200] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.294887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.356885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2a29-1fe1-47b7-8228-b914af67297a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.370305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.401803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.403876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.404571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.405385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.407391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.409034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.409140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb2199-d07e-4399-91f0-10f7ff6f19e0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.413240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 100/201] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.414261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.446835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.447624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.448002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.448323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.449601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.451179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.452883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 102/202] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.453886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.476868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.540599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5d4b-c23a-4329-bf6f-88419eb519bc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.569830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259604fb-b7ac-484f-8ebd-7556ecfe29fe None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.577090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.577731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.578016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.578984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] PATH_INFO: `/v3/users/e984244789e144dda07985a5bf7fdea1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.579733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] RBAC: Authorizing `identity:get_user(user_id=e984244789e144dda07985a5bf7fdea1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.581314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.583250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 101/203] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/users/e984244789e144dda07985a5bf7fdea1 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.585280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.606650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=c9a4f3a605c04925a4e0d4e20ebde5fd) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.614159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.617679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 103/204] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/role_assignments?user.id=c9a4f3a605c04925a4e0d4e20ebde5fd&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.618477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.642603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.756826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237452-f940-4b2e-9abb-31d033c1ffc8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.769520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.814799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.818232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132acd4-40ac-493e-9ade-0b97930801e7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.819169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.819664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.820162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.821163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=c9a4f3a605c04925a4e0d4e20ebde5fd) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:26.821711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.823405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.833635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 102/205] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/role_assignments?user.id=c9a4f3a605c04925a4e0d4e20ebde5fd&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.857910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.858581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.858864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.859140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.948552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.950050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.041839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.063584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 104/206] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:27.069179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.186049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e210-2fe2-42ed-8144-e38bac5084c7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.196897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.229413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.230526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.231068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.231543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.233012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.234724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ddb2c-d88f-4535-8763-85b46c464201 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.238547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 103/207] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:27 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:27.247564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.375786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de706-d6ee-45fb-8195-06648df48d12 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.414691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.415318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.415605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.415880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.416629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, scope.project.id=d2e70b37f9f34682862278cc31b4db12, user.id=e984244789e144dda07985a5bf7fdea1) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:27.416944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.418381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739c3d-8cd2-42b3-aa3b-7e53454e26ca None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.424733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 105/208] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:27 2022] GET /identity/v3/role_assignments?user.id=e984244789e144dda07985a5bf7fdea1&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=c937b50f403345129308873cb7c1ee19 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:27.943260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f694-a3ed-43f8-adbe-a7e73cbe0fe2 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.943790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f694-a3ed-43f8-adbe-a7e73cbe0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.943790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f694-a3ed-43f8-adbe-a7e73cbe0fe2 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.945301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 104/209] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:27.950811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb891-5e38-4dad-8eb6-fd45b25b5b5d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.951249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb891-5e38-4dad-8eb6-fd45b25b5b5d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.951458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb891-5e38-4dad-8eb6-fd45b25b5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.975127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c7adb891-5e38-4dad-8eb6-fd45b25b5b5d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:27.976667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c7adb891-5e38-4dad-8eb6-fd45b25b5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:28.036045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.063889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 106/210] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:28.141495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649422e-bcab-4d4a-af1f-85f5febf8d88 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.141857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649422e-bcab-4d4a-af1f-85f5febf8d88 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.142246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649422e-bcab-4d4a-af1f-85f5febf8d88 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.144667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 105/211] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:28.149936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.150304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.150707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.170386 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:28.171620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:28.242540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 107/212] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:28.342082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649422e-bcab-4d4a-af1f-85f5febf8d88 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.447059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649422e-bcab-4d4a-af1f-85f5febf8d88 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.481940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.482616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.482899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.483177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.494248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:28.499165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:28.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:28.500855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 106/213] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:28.507203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.513751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.565211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.630890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbb4d-6656-4bc0-a001-2adb290f937d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.640254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d0e6-c1a0-4a85-82df-d9a609d76bdf None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.684631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.718547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.719091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.719377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.719650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.720521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.720763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.722001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.722246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.722825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.723246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.724055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 107/214] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:28.724229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:28.724669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.726240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.729408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.737302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 108/215] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:28.746977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.858565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647734-9a2a-42c3-bcb7-408294ab6b12 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.871989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d865-abd4-4a04-a10b-f6d1cc51d895 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.882873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.905525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.913765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.913765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.913765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.913765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.913765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63281b6-9602-494b-b244-298a94a93d38 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.914159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.914159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.914159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.914159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] PATH_INFO: `/v3/users/3de78c6faa134fd4931a169589a4825b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.927963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] RBAC: Authorizing `identity:get_user(user_id=3de78c6faa134fd4931a169589a4825b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.929416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a425cb-bca1-4da7-a9da-ff78953158f3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.931181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 109/216] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/users/3de78c6faa134fd4931a169589a4825b => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:28.935728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692dcf-f341-4477-81ad-db5e9ab1ea58 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.936238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692dcf-f341-4477-81ad-db5e9ab1ea58 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.936517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692dcf-f341-4477-81ad-db5e9ab1ea58 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.937789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 110/217] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:28.938527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87692dcf-f341-4477-81ad-db5e9ab1ea58 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.965613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.017997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 108/218] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:28 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:29.020003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5fc1-d34f-46ca-866f-4f283e68b458 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.020277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5fc1-d34f-46ca-866f-4f283e68b458 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.020549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5fc1-d34f-46ca-866f-4f283e68b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.040304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-78dc5fc1-d34f-46ca-866f-4f283e68b458 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:29.041526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-78dc5fc1-d34f-46ca-866f-4f283e68b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:29.048630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87692dcf-f341-4477-81ad-db5e9ab1ea58 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.094394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.095049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.095328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.095777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.121997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 109/219] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:29.123261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497530a-221e-4558-86f5-bdfb6281ebaf None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.123554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497530a-221e-4558-86f5-bdfb6281ebaf None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.123829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497530a-221e-4558-86f5-bdfb6281ebaf None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.129806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 110/220] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:29.131425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.131712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.131984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.160667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:29.162976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:29.187487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:29.188949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:29.224844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.254966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 111/221] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:29.316594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 111/222] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:29.322235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.352372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.389143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.444746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da8d4-6265-4509-9f69-13347b7ccccf None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.494868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.495521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.496335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.496620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.498100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:29.500571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:29.502933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 112/223] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:29.509408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.516076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ebdb-d750-4cc5-adfb-039d829b7200 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.555068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.572845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.572845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.572845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.572845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.583902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:29.591424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:29.596490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 112/224] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:29.598135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.637634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.649443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba334-1576-411b-9bff-4ab748823fb1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.689138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842489c-6433-4771-87c0-6157abb665be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.689468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842489c-6433-4771-87c0-6157abb665be None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.689724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842489c-6433-4771-87c0-6157abb665be None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.689995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842489c-6433-4771-87c0-6157abb665be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.690883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842489c-6433-4771-87c0-6157abb665be None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=3de78c6faa134fd4931a169589a4825b) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:29.691194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842489c-6433-4771-87c0-6157abb665be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:29.692716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842489c-6433-4771-87c0-6157abb665be None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:29.698652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 113/225] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/role_assignments?user.id=3de78c6faa134fd4931a169589a4825b&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:29.699489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842489c-6433-4771-87c0-6157abb665be None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.726639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947f5a5-0a28-46c3-a13d-fe1d060a2881 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.766656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.767690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.768162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.768606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.781533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:29.792336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:29.793309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:29.794096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:29.802923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 113/226] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:29.804247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.811416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842489c-6433-4771-87c0-6157abb665be None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:29.850387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:29.851207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:29.851587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:29.851962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:29.852732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:29.853210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:29.854623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:29.865746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 114/227] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:29.873080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:29.887502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.908343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:29.982154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7877-ec98-4e4e-8fcb-70c199eaeaf4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.044513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.045133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.045412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.045684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.047123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:30.047429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.048820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.058399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7a9c5-b4a5-499c-a1e8-72ec37b7fc56 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.068819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 114/228] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:30.075566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.123295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.123855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.124134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.124409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.125542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.127019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.131262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 115/229] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:29 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:30.135917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.245015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbcd53-cc11-435a-b0a7-1e9ed1ad5101 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.258795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.282698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.306568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.308902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.308902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.308902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.310205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca47ff-91e3-401f-b475-b2bc5e50338f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.312228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.313694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.315307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 115/230] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:30.323924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.383775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.384338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.384618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.385072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.387605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.389238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.392941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 116/231] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:30.400595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.479418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fb360-de66-47bb-8fd2-bfa83d4d2583 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.525552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.526200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.526496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.526771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.530742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.532218 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.539007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 116/232] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:30.547128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.573589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89039-5751-4794-a342-8c338314fa4b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.617314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.617982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.618261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.618550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/c9a4f3a605c04925a4e0d4e20ebde5fd/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.624930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, user_id=c9a4f3a605c04925a4e0d4e20ebde5fd, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.626405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954220c-1ed1-4eee-8af0-b7358650611a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.687744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.708862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 117/233] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:30 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/c9a4f3a605c04925a4e0d4e20ebde5fd/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:30.757782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2978-04f1-4498-9821-0937cf057850 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.807576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.808567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.809032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.809514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/c9a4f3a605c04925a4e0d4e20ebde5fd/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.816090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, user_id=c9a4f3a605c04925a4e0d4e20ebde5fd, role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.817982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb595902-fc07-4444-8321-edbae6cd91b3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.918653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:30 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/c9a4f3a605c04925a4e0d4e20ebde5fd/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:31.432673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3583-5e5c-48d6-a175-46ce589252c0 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.433184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3583-5e5c-48d6-a175-46ce589252c0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.433184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3583-5e5c-48d6-a175-46ce589252c0 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.434762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 118/235] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:31.440064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.440495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.441208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.463870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:31.465051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:31.517408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671ec1-a15d-461f-83f1-cf5c2b413560 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.518047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671ec1-a15d-461f-83f1-cf5c2b413560 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.518614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671ec1-a15d-461f-83f1-cf5c2b413560 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.520834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 119/236] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:31.526349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.526929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.527405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.546298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:31.547856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:31.556706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:31.566532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 118/237] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:31.628727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 120/238] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:31.900992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.940822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.943275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.077323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cb69f-e06c-47f6-a953-daea273524de None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.094152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b037e-b4dc-4a2f-8951-1405da195aed None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.127191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.128743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.129444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.129871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.131618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.132433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.132817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.133187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.134367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.136242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a6435-6b21-4e10-8c7c-97c222e75d4a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.138215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 121/239] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:32.141714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:32.143792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6252-df7d-4430-a996-d1d76bf38a6d None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.144179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6252-df7d-4430-a996-d1d76bf38a6d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.144516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6252-df7d-4430-a996-d1d76bf38a6d None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.145974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 122/240] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:32.147117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6252-df7d-4430-a996-d1d76bf38a6d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c2c7fd4b-9b40-4332-8917-55ca4fa9d4e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:32.148241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:32.149119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:32.149923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:32.151779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 119/241] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:32.157251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.157251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.157251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.166519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.180879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:32.183110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:32.262546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 120/242] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:32.263571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.292655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6252-df7d-4430-a996-d1d76bf38a6d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.313331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.359958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.360477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.360761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.361028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.361683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.370511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.424003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425cce-bd0e-4f5e-a6e7-28424a47ad04 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.458944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.459553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.459816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.460089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.460749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:32.461052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.462424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.471202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 121/243] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:32.477359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.500579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 123/244] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:32 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:32.561943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.585361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.602829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2ab82-9dfe-486b-93da-0c28f1fd7e82 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.634751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.640111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.640765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.641049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.641325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] PATH_INFO: `/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.656899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] RBAC: Authorizing `identity:get_user(user_id=3c52e5261c9b49a5bc93e2266c07d7e3)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.658518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.661505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 122/245] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:32.667030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.678129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed718f7-00a9-4ba1-8fdf-dbe1198871fc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.719517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.720183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.720469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.720740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.732399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:32.740537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:32.741498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:32.742283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:32.742928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 124/246] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:32.749605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:32.785676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a2244-f6ca-4370-b39f-e4f0bfbf9503 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.837035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.837670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.837958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.838237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.858797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.869369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad6f4-a350-4f18-88c8-b3c42f46f45b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:32.907709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:32.919963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:32.920867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:32.921522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:32.921945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:32.923225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:32.923535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.926290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.927495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:32.929716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:32.940850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 125/247] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:32.944109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:33.067136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 123/248] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:36:33.072972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:33.088516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4be6-055c-4225-9db0-578429148d94 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:33.127728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:33.138404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] PATH_INFO: `/v3/users/3de78c6faa134fd4931a169589a4825b` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] RBAC: Authorizing `identity:get_user(user_id=3de78c6faa134fd4931a169589a4825b)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:33.146121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 126/249] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:32 2022] GET /identity/v3/users/3de78c6faa134fd4931a169589a4825b => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:33.153925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:33.205118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede47d4-6a9c-430d-b7aa-1f3492b7f8e5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:33.235032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:33.242878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:33.245455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.245455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.245455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.246569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:33.248249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:33.250123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 124/250] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:33 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:33.256532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:33.296726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c40fb-125f-40a9-a3ca-428eef58bc0f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:33.340544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:33.341531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.342123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.342623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.344912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:33.347493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:33.349770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 127/251] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:33 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:33.359462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:33.383313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223157ee-f3be-44e4-8164-ebb886556173 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:33.400859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:33.422967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:33.424126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.424126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.424126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.424861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=3c52e5261c9b49a5bc93e2266c07d7e3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:33.425170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:33.428291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4014-4260-4a7c-bf25-13194c0cdc51 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:33.439401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 125/252] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:33 2022] GET /identity/v3/role_assignments?user.id=3c52e5261c9b49a5bc93e2266c07d7e3&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=c937b50f403345129308873cb7c1ee19 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:33.440697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f60d2-338c-4cf7-9f8c-532d708a983a None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.440981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f60d2-338c-4cf7-9f8c-532d708a983a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.441275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f60d2-338c-4cf7-9f8c-532d708a983a None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.442581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 126/253] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:33.443657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e7b6-ec6b-4548-bc62-c1d647c59fe5 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.443937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e7b6-ec6b-4548-bc62-c1d647c59fe5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.444209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e7b6-ec6b-4548-bc62-c1d647c59fe5 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.445467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 127/254] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:33.451335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb01e-56b0-4cf4-b74b-69f2c9f91f4d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.451627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb01e-56b0-4cf4-b74b-69f2c9f91f4d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.451890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb01e-56b0-4cf4-b74b-69f2c9f91f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.472409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-535bb01e-56b0-4cf4-b74b-69f2c9f91f4d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:33.473467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-535bb01e-56b0-4cf4-b74b-69f2c9f91f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:33.494699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859849e7-be2e-494f-a18c-8fc4aa43eb1a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:33.533096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:33.554608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:33.555719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.556312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.556778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/3de78c6faa134fd4931a169589a4825b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.561507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, user_id=3de78c6faa134fd4931a169589a4825b, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:33.561711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 128/255] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:33.562943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.563228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.563502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.564218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:33.594375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:33.595687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:33.648518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 128/256] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:33 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/3de78c6faa134fd4931a169589a4825b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:33.695793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 129/257] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:33.931057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.038783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d355-7973-43bb-8428-f9b3a1c1c609 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.081732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.082636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.083068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.083510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.101734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:34.106972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:34.108041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:34.109025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:34.115020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 129/258] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:34.120917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.179640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.246183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf576be-d3ab-4d4d-a761-29b00e184e52 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.281750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.290184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.290842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.291131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.291468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.292164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:34.292470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.293930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.305153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 130/259] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:34.310954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.382904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.490776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.497884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe8c2-cd3a-4dcd-af99-652dcfa61f54 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.500341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b4330-695c-451d-b748-fdf7016c4547 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.546831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efff61-a732-43c9-8109-6de00851346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.547493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efff61-a732-43c9-8109-6de00851346e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.547748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efff61-a732-43c9-8109-6de00851346e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.548025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efff61-a732-43c9-8109-6de00851346e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.558942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efff61-a732-43c9-8109-6de00851346e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:34.561045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.561685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.561971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.562249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-34efff61-a732-43c9-8109-6de00851346e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:34.563980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:34.564849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:34.566244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 130/260] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:34.567497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.568599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.570711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 131/261] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:34.571816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efff61-a732-43c9-8109-6de00851346e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.576412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.705735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efff61-a732-43c9-8109-6de00851346e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.708912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.742722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.743342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.743626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.743898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.744635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:34.745104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.745978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0eae4-34fd-4918-80a8-a8cf41155f37 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.746322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.765915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 131/262] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:34.771778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.823252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.823954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.824247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.824528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.891249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.962248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.963666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.986669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1358-4812-4774-aa4b-0a5458995758 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.048065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.048720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.049006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.049282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] PATH_INFO: `/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.051836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a4f3a605c04925a4e0d4e20ebde5fd)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:35.053308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:35.056195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 132/263] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/users/c9a4f3a605c04925a4e0d4e20ebde5fd => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:35.060847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:35.113813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:35.168181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 132/264] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:36:35.179603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:35.238824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2daf91-2f30-4f0d-a67e-34060a897ee2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.300729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.301703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.302204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.302708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.345697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:35.388272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc5b6-b487-49fc-b692-6c138b3245d9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.390111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:35.391811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:35.426601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.427072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.427359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.427636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.428776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:35.430339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:35.432381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 133/265] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:35 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:35.437853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:35.450390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:35.568606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 133/266] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:36:35.575245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:35.608853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8712-9f63-4d95-be7a-299671965b99 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.680910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.681541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.681828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.682106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.682970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=c9a4f3a605c04925a4e0d4e20ebde5fd) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:35.683287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:35.684753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:35.686728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:35.692628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 134/267] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:35 2022] GET /identity/v3/role_assignments?user.id=c9a4f3a605c04925a4e0d4e20ebde5fd&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:35.762789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892e37-39ed-4a1a-8465-85ba42dcbbae None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.809280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.810370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.810826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.811243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.812626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:35.814258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca95a-c51d-4bba-b729-d9f85ba2853c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:35.817295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 134/268] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:35 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:35.823645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:35.960673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8e42-2660-48ed-adc8-369d9876334e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:35.998563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:35.999187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.999475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.999755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.000503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=c9a4f3a605c04925a4e0d4e20ebde5fd) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:36.000817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:36.002279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2cbcb-a256-4b48-86be-b836cef4d1df None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:36.009220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 135/269] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:35 2022] GET /identity/v3/role_assignments?user.id=c9a4f3a605c04925a4e0d4e20ebde5fd&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:36.110476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb14d-4262-41ac-bc2c-0990edd143b6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.111088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb14d-4262-41ac-bc2c-0990edd143b6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.111561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb14d-4262-41ac-bc2c-0990edd143b6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.114031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 135/270] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:36.119378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7b39-5d8e-45a5-9160-3bcb937edf2a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.119677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7b39-5d8e-45a5-9160-3bcb937edf2a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.119960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7b39-5d8e-45a5-9160-3bcb937edf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.145480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-3dcd7b39-5d8e-45a5-9160-3bcb937edf2a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:36.146938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3dcd7b39-5d8e-45a5-9160-3bcb937edf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.181003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca1d7-b0f6-4c64-9056-3b21a5c71c3b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.181640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca1d7-b0f6-4c64-9056-3b21a5c71c3b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.182117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca1d7-b0f6-4c64-9056-3b21a5c71c3b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.183892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 136/271] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:36.189578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87cb2-f908-453f-a1b7-25aef7582701 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.190744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87cb2-f908-453f-a1b7-25aef7582701 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.191992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87cb2-f908-453f-a1b7-25aef7582701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.212357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.236853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 136/272] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:36.238217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-30e87cb2-f908-453f-a1b7-25aef7582701 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:36.245719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.245865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-30e87cb2-f908-453f-a1b7-25aef7582701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.343332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 137/273] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:36.349538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f92be-bf49-4bee-a0c7-ab395b633a86 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.349954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f92be-bf49-4bee-a0c7-ab395b633a86 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.350340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f92be-bf49-4bee-a0c7-ab395b633a86 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.353060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 137/274] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:36.357280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.357745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.358170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.380110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:36.381539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.432512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4342cb-f408-4cab-b206-5c81eb88ed33 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.433229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4342cb-f408-4cab-b206-5c81eb88ed33 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.433711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4342cb-f408-4cab-b206-5c81eb88ed33 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.435295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 138/275] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:36.440879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.441483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.441965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.458668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 138/276] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:36.465637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:36.466870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.540956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 139/277] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:36.570989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.634939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.651196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.674384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae420-bc2b-4a86-9b50-9ebc178543fe None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:36.711348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:36.711982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.712262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.712533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.713724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:36.715215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:36.717475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 139/278] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:36.722573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.764293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19995f2-4dd3-482e-8fab-ea577cf01c49 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:36.787974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.799571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:36.800212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.800755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.801631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.813794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:36.816969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:36.817850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:36.819658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 140/279] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:36.820343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.833846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554010-095e-4b40-bd73-c4ed0db5b93c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:36.862140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.867866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:36.868505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.868786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.869065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.870350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:36.871185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:36.922251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49bb42-81cb-41ce-8ce6-c817c8c73186 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:36.951181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 140/280] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:36.958591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:36.959576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.959719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.960015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.960248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.977575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:36.983546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:36.984661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:36.985642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:36.987175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 141/281] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:36.987175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.040635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.091811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde6ad6-20ea-4100-a78d-aff261f67114 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.106242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e946d-bdac-4818-bba3-e7a99151d384 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.131546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.131546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.131804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.132056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.132714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:37.133021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.134687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.143722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 141/282] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.144674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.151462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.152159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.152449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.152725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.166289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:37.171246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:37.172132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 142/283] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:37.174810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.213675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.276162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7d51-9a07-4b73-acbe-7083351e732f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.310418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76ab53-a89b-425d-9c59-3eb80964c18a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.312113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.323023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.323973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.324739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.325362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.326338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:37.326802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.328876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.340472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 142/284] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.341831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.349168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.349999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.350377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.350773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] PATH_INFO: `/v3/users/9bb27fd90cd34a37a2875b78c46458ea` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.367763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] RBAC: Authorizing `identity:get_user(user_id=9bb27fd90cd34a37a2875b78c46458ea)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.369490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.371693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 143/285] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/users/9bb27fd90cd34a37a2875b78c46458ea => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.372652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.462224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807c5f2-c2e3-42e0-bf95-e0bcfa09564e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.474637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.499547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.500322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.500707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.501186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.501959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:37.502460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.504281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.512659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27f38-eadf-462d-a9a8-0361094d922d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.518192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 143/286] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.518192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.567912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.569307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.569997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.570474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] PATH_INFO: `/v3/users/3de78c6faa134fd4931a169589a4825b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.572069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] RBAC: Authorizing `identity:get_user(user_id=3de78c6faa134fd4931a169589a4825b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.574080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.576839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 144/287] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/users/3de78c6faa134fd4931a169589a4825b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.577956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.613201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.632377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2ca2-0872-4a15-9ae9-2457da535af6 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.669324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.669940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.670225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.670522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.671260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, user.id=9bb27fd90cd34a37a2875b78c46458ea, scope.system=all) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:37.671623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.673132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.678529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 144/288] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/role_assignments?user.id=9bb27fd90cd34a37a2875b78c46458ea&scope.system=all&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.683492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.702912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d6b30-5d0b-4929-8d6a-9f2370e6c31f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.744999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.745886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.746306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.747285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] PATH_INFO: `/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.748692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] RBAC: Authorizing `identity:get_user(user_id=3c52e5261c9b49a5bc93e2266c07d7e3)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.750345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.752579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 145/289] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.759275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.798846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.871633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.879734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b840-59f3-4c86-bb00-359a9c658e24 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.919340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.920376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.920827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.921506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.922816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:37.925610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:37.927713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 146/290] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:37.933558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.942625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c657-115c-46bb-ac75-939a1274de72 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.979490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.980116 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.980405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.980680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.038898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34bfc-f1f8-4824-b3a5-e203407c2ca9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.052629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.054164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.086468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.087590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.088107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.088582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/3c52e5261c9b49a5bc93e2266c07d7e3/roles/c937b50f403345129308873cb7c1ee19` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.090785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, user_id=3c52e5261c9b49a5bc93e2266c07d7e3, role_id=c937b50f403345129308873cb7c1ee19)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.092448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.094821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.164254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 145/291] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:38.165814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.190714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 147/292] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:37 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/users/3c52e5261c9b49a5bc93e2266c07d7e3/roles/c937b50f403345129308873cb7c1ee19 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:38.278811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347d11-50d7-46fc-8426-dd207ea022ca None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.319703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.320290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.320574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.320852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.322253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.323770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869deb2b-738c-460a-afc3-05c7b707c4e5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.325438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 146/293] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.331931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.380631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.468343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270cb67-fca4-44b7-b26a-96cb6c5c9d19 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.505767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.506384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.506689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.506960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.507698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=3de78c6faa134fd4931a169589a4825b) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:38.508016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.509435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f4412-0172-49ba-a1bd-300a9934f5e9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.515881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 148/294] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/role_assignments?user.id=3de78c6faa134fd4931a169589a4825b&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.159496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d0d2-ba63-4b73-ba75-4f942a7854ed None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.159992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d0d2-ba63-4b73-ba75-4f942a7854ed None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.160126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d0d2-ba63-4b73-ba75-4f942a7854ed None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.161794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 147/295] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:39.166746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d571-f415-4f4e-9d7c-d9e8e4e06639 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.167156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d571-f415-4f4e-9d7c-d9e8e4e06639 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.167459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d571-f415-4f4e-9d7c-d9e8e4e06639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.190141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-64b0d571-f415-4f4e-9d7c-d9e8e4e06639 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:39.191372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-64b0d571-f415-4f4e-9d7c-d9e8e4e06639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:39.259051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 149/296] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:39.280468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f7a-d20d-4e16-a25b-d15cd5330851 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.281075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f7a-d20d-4e16-a25b-d15cd5330851 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.281576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f7a-d20d-4e16-a25b-d15cd5330851 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.283149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 148/297] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:39.288985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.289269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.289546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.308065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:39.309233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:39.322383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.376719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 150/298] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:39.546813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5f7a-d20d-4e16-a25b-d15cd5330851 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.552000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.650766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.701102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5f7a-d20d-4e16-a25b-d15cd5330851 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.747664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.749289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.749783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.750557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.757237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4cd81-d9db-489c-ae30-8ac3ebfb69e0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.764372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:39.772626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:39.773542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:39.774333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:39.775972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 149/299] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:39.781416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.804908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.805636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.805913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.806183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.807316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.808761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.814907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 151/300] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:39.816384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.836381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.870668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.915376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7b7-ae05-4deb-af0f-25a5adf08926 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.926768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f360ede-810e-4982-a610-56f0d51075f8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.950530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.951147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.951430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.951709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.952373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:39.952679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.954071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6de28-fcb7-4965-8f6b-bdde37cd912c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.962576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 150/301] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:39.963762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e905c-9ad3-4ab5-9568-39ed3a8b9151 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.964051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e905c-9ad3-4ab5-9568-39ed3a8b9151 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.964327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e905c-9ad3-4ab5-9568-39ed3a8b9151 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.969589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 151/302] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:39.970350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e905c-9ad3-4ab5-9568-39ed3a8b9151 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.971769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.972704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.973135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.973755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] PATH_INFO: `/v3/groups` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.975460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.977092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006929b-a6d9-4a22-968d-0ac0d1d5d4e5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.043306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 152/303] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Aug 30 14:36:39 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:40.044548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.044835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.045108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.065106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:40.066553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:40.082950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e905c-9ad3-4ab5-9568-39ed3a8b9151 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.115920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.125864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.126943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.127407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.127832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] PATH_INFO: `/v3/users/41dff8a36beb42cb9b58adfb2764d8ca` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.144077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] RBAC: Authorizing `identity:get_user(user_id=41dff8a36beb42cb9b58adfb2764d8ca)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.145985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.148223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 152/304] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/users/41dff8a36beb42cb9b58adfb2764d8ca => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.153748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.167368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 153/305] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:40.262619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3caa43-12e9-4b19-8194-b8df84456d0f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.303665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.304281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.304564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.304833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.305560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, user.id=41dff8a36beb42cb9b58adfb2764d8ca, scope.system=all) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:40.305867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.307305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7273-a2b4-4bf6-8b10-0bd9c0cbf1ed None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.312724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 153/306] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/role_assignments?user.id=41dff8a36beb42cb9b58adfb2764d8ca&scope.system=all&role.id=c937b50f403345129308873cb7c1ee19 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:40.442799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.451152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.522187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741669-1572-4974-8dc3-be587f2acf0f None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.522498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741669-1572-4974-8dc3-be587f2acf0f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.522776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741669-1572-4974-8dc3-be587f2acf0f None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.524388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 154/307] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:40.529383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.529675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.529957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.550529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:40.551571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459cb03-45c1-45ca-b9c5-0ca6e51f92fa None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.551743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:40.598042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.599192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.599474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.599748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.600529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.614588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:40.621322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:40.622241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:40.623090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:40.623696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 154/308] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:40.626162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 155/309] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:40.631488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.699383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.733016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423314ae-edcf-4b6d-81c9-9b49ad1dbc4c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.769047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.769666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.769949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.770223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.770928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:40.771234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.772612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.781266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 155/310] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.787510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.898853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cfdfe-6dd6-4c8d-b21f-1b3da40da501 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.928638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.935074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.935714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.935992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.936321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] PATH_INFO: `/v3/users/9bb27fd90cd34a37a2875b78c46458ea` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.937452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] RBAC: Authorizing `identity:get_user(user_id=9bb27fd90cd34a37a2875b78c46458ea)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.938905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.941237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 156/311] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/users/9bb27fd90cd34a37a2875b78c46458ea => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.945858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.998335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.056329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23d35-ac73-43ed-93c4-df8356ac642a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.079045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06ce4-f653-49b8-90a1-ef24472ef645 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.092953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.093721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.094103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.094511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] PATH_INFO: `/v3/system/users/9bb27fd90cd34a37a2875b78c46458ea/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.096044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9bb27fd90cd34a37a2875b78c46458ea, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:41.098183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:41.113580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.122053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.122965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.123400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.126268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.136693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:41.142277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:41.143991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:41.145825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 156/312] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:41.149852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:41.210469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 157/313] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Aug 30 14:36:40 2022] PUT /identity/v3/system/users/9bb27fd90cd34a37a2875b78c46458ea/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:41.270037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ae6e-a96d-4974-8034-ba9c21bf0c12 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.310428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.311129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.311420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.311696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.312439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:41.312754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:41.314225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:41.324266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 157/314] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:41.330138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:41.441215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649babf-e50f-40eb-a3ed-26e860366325 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.451859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.477887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.478611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.478899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.479177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] PATH_INFO: `/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.480347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] RBAC: Authorizing `identity:get_user(user_id=3c52e5261c9b49a5bc93e2266c07d7e3)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:41.481863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:41.483646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 158/315] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:41 2022] GET /identity/v3/users/3c52e5261c9b49a5bc93e2266c07d7e3 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:41.490055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:41.546250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.598422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f929-136b-4581-8b63-334251b80420 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.634033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.634672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.634956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.635230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.705860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:41.707726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:41.758085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.809957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 158/316] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:41.816614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:41.922369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e381d85-9d29-480b-8dda-fd2c516385ac None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:41.958274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:41.959280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.959847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.960312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.961686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:41.963328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99e94-96f1-4c10-9aad-db4b41474e0e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:41.965426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 159/317] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:41 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:41.972096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.078059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df851-9099-45a9-9eaf-048e16221918 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.108536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143057-7aba-4b37-a928-e23b93e77edb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.108833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143057-7aba-4b37-a928-e23b93e77edb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.109096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143057-7aba-4b37-a928-e23b93e77edb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.110936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 160/318] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:42.114294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.114942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.115231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.115509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.116440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe, user.id=3c52e5261c9b49a5bc93e2266c07d7e3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:42.116755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.117220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22df5-3b9f-4db5-814e-d4a0a23031bc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.117706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22df5-3b9f-4db5-814e-d4a0a23031bc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.118178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22df5-3b9f-4db5-814e-d4a0a23031bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.118293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869742e-951b-41a6-8360-a067ce88de0e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.124745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 159/319] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:41 2022] GET /identity/v3/role_assignments?user.id=3c52e5261c9b49a5bc93e2266c07d7e3&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=c937b50f403345129308873cb7c1ee19 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:42.138433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2ef22df5-3b9f-4db5-814e-d4a0a23031bc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:42.140057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2ef22df5-3b9f-4db5-814e-d4a0a23031bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:42.194387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.221446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:42.337912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434121-e6eb-431e-8340-50478f55c582 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.338379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434121-e6eb-431e-8340-50478f55c582 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.338379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434121-e6eb-431e-8340-50478f55c582 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.340047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 160/321] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:42.345368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.345822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.346122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.366426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:42.367653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:42.437836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 162/322] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:42.498388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434121-e6eb-431e-8340-50478f55c582 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.514478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.601859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434121-e6eb-431e-8340-50478f55c582 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.635646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.636276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.636556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.636825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.637900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.639398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.641159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 161/323] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:42.647030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.709935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.754989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2685c-4385-40e3-8c64-49c18b9d4849 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.762780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.791129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.791778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.792062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.792374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] PATH_INFO: `/v3/groups` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.793016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.795533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.799171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.817859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed55eb-6971-4a04-abd0-8691dec02c41 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.853002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.853568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.853874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.854146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.863970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:42.869194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:42.870291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:42.871307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:42.875129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 162/324] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:42.875768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.877120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 163/325] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:42.989032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c567-263b-4da3-8d37-8399a6de0d04 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.026846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.027804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.027804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.028013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.028646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:43.028950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.030348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.039512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 163/326] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:43.045029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.151699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c665a39-a82b-4271-b44e-09eed4083a91 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.190163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.190861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.191149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.191415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] PATH_INFO: `/v3/users/41dff8a36beb42cb9b58adfb2764d8ca` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.192564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=41dff8a36beb42cb9b58adfb2764d8ca)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.194023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46f221-d2ad-477b-9820-1ca62948a9c7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.195945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 164/327] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/users/41dff8a36beb42cb9b58adfb2764d8ca => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:43.202062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.207497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.251814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c9b2-7116-4941-9cc0-bad45f22c05a None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.252459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c9b2-7116-4941-9cc0-bad45f22c05a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.252939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c9b2-7116-4941-9cc0-bad45f22c05a None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.254490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 165/328] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:43.261336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.261624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.261902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.285252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:43.286690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:43.323916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.337013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ff2e-112b-48de-8709-7be1772ef701 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.381546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 166/329] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:43.387483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.388156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.388443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.388817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] PATH_INFO: `/v3/system/users/41dff8a36beb42cb9b58adfb2764d8ca/roles/c937b50f403345129308873cb7c1ee19` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.390275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=41dff8a36beb42cb9b58adfb2764d8ca, role_id=c937b50f403345129308873cb7c1ee19)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.391770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.460539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 164/330] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Aug 30 14:36:43 2022] PUT /identity/v3/system/users/41dff8a36beb42cb9b58adfb2764d8ca/roles/c937b50f403345129308873cb7c1ee19 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:43.666803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.840500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825647d4-c196-4dbc-8e56-02f9e548eb36 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.886374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.887055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.887338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.887610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.904354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:43.909337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:43.910207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:43.911443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 167/331] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:43.916533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.997862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.037079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd39cc3-56bc-4bba-bfed-773e97d30157 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.079006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.079625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.079906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.080185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.081380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:44.081833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.083344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.091979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 165/332] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.098291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.136971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.231425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284ad6-4f85-44c0-bcba-2de5f09df859 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.277457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.278106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.278386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.278763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] PATH_INFO: `/v3/users/9bb27fd90cd34a37a2875b78c46458ea` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.279924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] RBAC: Authorizing `identity:get_user(user_id=9bb27fd90cd34a37a2875b78c46458ea)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.281344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab315-ee40-47cd-b411-26d63b1f89cf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.282954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 168/333] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/users/9bb27fd90cd34a37a2875b78c46458ea => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.289512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.404031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d9ce-b493-403f-a033-4ff337cd988a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.437492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.444484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.445401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.445886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.446362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.447383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] RBAC: Adding query filter params (role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, user.id=9bb27fd90cd34a37a2875b78c46458ea, scope.system=all) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:44.447951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.449729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b221-30d6-46b4-a33b-6d2cebcccae3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.464830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 166/334] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/role_assignments?user.id=9bb27fd90cd34a37a2875b78c46458ea&scope.system=all&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.891407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab96e-1b35-4c24-a47e-8b1e0b6f36ae None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.891970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab96e-1b35-4c24-a47e-8b1e0b6f36ae None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.891970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab96e-1b35-4c24-a47e-8b1e0b6f36ae None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.893616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 169/335] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:45.899021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253238c-05e5-472a-8cae-5971e8db42da None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.899847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253238c-05e5-472a-8cae-5971e8db42da None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.900340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253238c-05e5-472a-8cae-5971e8db42da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.927470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4253238c-05e5-472a-8cae-5971e8db42da None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:45.929010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4253238c-05e5-472a-8cae-5971e8db42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.015803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 167/336] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:46.052830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5775d5-00f9-4eb9-8072-717283105598 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.053186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5775d5-00f9-4eb9-8072-717283105598 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.053373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5775d5-00f9-4eb9-8072-717283105598 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.054813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 170/337] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.055947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93745f-b8bb-4f87-93ad-fac32f845436 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.056443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93745f-b8bb-4f87-93ad-fac32f845436 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.056944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93745f-b8bb-4f87-93ad-fac32f845436 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.058493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 168/338] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:46.060667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c850-a95a-42ab-895f-c4a9cfc599a0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.060965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c850-a95a-42ab-895f-c4a9cfc599a0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.061242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c850-a95a-42ab-895f-c4a9cfc599a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.063228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.063727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.064204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.088367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4028c850-a95a-42ab-895f-c4a9cfc599a0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.088367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4028c850-a95a-42ab-895f-c4a9cfc599a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.089768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.091297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.213295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 169/339] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:46.226481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 171/340] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:46.449327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.464999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55adcc-ef86-4b0a-8cab-bbb6940fc768 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.465755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55adcc-ef86-4b0a-8cab-bbb6940fc768 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.466681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55adcc-ef86-4b0a-8cab-bbb6940fc768 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.468520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 172/341] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.477080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.477988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.478768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.514187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.515780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.525251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.555833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.615700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb31da-a3f6-469c-9517-b7e20d40c603 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.639969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 173/342] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:46.665534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.666183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.666481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.666764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.683187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:46.688184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:46.689054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:46.690859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 170/343] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:46.695893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.715478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.829171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2790f-1f17-4048-bdfe-f0f030029624 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.839516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.867751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548734e-474c-4403-935f-1bc5626a64d0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.880912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.881995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.883062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.883570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.896420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:46.902164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:46.903495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:46.904403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:46.907979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 171/344] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:46.909336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.921183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.923203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.923567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.924448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.926071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:46.926504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.929107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2c82-cfce-4e9d-8404-6618022aee80 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.943155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 174/345] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:46.944400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70894117-477a-4e3a-bafb-c6f9a7780c40 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.944694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70894117-477a-4e3a-bafb-c6f9a7780c40 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.944972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70894117-477a-4e3a-bafb-c6f9a7780c40 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.950522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 175/346] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.951282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70894117-477a-4e3a-bafb-c6f9a7780c40 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.977658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.029971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557c27-7d7b-4c0b-9e45-42f589bd84f8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.068847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.069519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.071071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.071071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.077998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70894117-477a-4e3a-bafb-c6f9a7780c40 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.086479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:47.092837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:47.093763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:47.094747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 172/347] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:47.096264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.124802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.125235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.125518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.125792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.128490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:47.128490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.129356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db38e-a6d3-4a4f-be45-ef112f566230 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.139300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 176/348] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.142088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.144903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.145623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.146558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.170275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:47.171513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:47.231606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973944c-b34f-440a-856a-3924374aa568 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.262259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 177/349] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:47.264191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.274210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.275122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.275583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.276057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.277072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.368742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.370653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.392582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49007e-a3db-42f1-8b2d-a11494f5a80f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.405905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.442424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.443226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.444356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.444712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.465114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:47.473861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:47.474881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:47.475710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:47.478222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 178/350] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:47.478933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.511046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 173/351] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:47.512241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.564856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.603713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19268-945b-46c3-b8bd-ee0cfc4b075d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.630309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf7151-a8e5-480d-bdd9-f9637bd171ab None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.655075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.655075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.655367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.655618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.656456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:47.658115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.660135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.669202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 179/352] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.669358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.670019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.673334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.675560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.682483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.682483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.763143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.763910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.796034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ac6bd-1b0e-4fd5-b354-09afb74ee266 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.829056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.836419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.836419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.836784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.840592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.840592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:47.840592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.840592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.850217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 180/353] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.851403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.902134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 174/354] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:47.902915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.936496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.981690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a305-eb8a-4a27-8fb9-7384334ffd41 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.020843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.021399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.021679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.021962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.023112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.024512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.026815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 181/355] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.027125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.029249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f33d-8685-4613-902a-0314bb5c2102 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.080328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.081068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.081357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.081632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.095407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:48.098553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-33bfe1fb-5957-400f-867b-17e119be82a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:48.102580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:48.114836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 175/356] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:48.115695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055a36-7cd6-486c-8d00-d4480023cbcd None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.116426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055a36-7cd6-486c-8d00-d4480023cbcd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.116426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055a36-7cd6-486c-8d00-d4480023cbcd None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.116426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 176/357] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:48.116426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055a36-7cd6-486c-8d00-d4480023cbcd None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.151136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344b98-4734-4772-9895-90a8a71fbcb9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.190795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.192189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.192626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.193042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.215906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.231572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055a36-7cd6-486c-8d00-d4480023cbcd None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.269576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.271195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.272933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.273583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.273868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.274145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] PATH_INFO: `/v3/users/41dff8a36beb42cb9b58adfb2764d8ca` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.275383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] RBAC: Authorizing `identity:get_user(user_id=41dff8a36beb42cb9b58adfb2764d8ca)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.276817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.278394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 177/358] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/users/41dff8a36beb42cb9b58adfb2764d8ca => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.283333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.345250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.396061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 182/359] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:48.396723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.399495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf97bf5-5177-4422-9985-981aacd92f63 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.444076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.444723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.445006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.445338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.447159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.448621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.450389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 178/360] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.451211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.479135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.522776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a56ad-09b5-4b91-aef0-48488c112d56 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.566221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.566896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.567175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.567448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.574616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.576306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3770fc-06ba-4fea-83d0-eaaef494a2f4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.577024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5688-b7de-4bcf-acb4-3d210b8ffd51 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.577939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 183/361] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.579195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.579477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.579755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.599505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:48.600713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:48.620008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.620714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.621334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.621610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.621879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.622576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:48.622876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.624227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.634828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 179/362] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.636032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.687358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 184/363] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:48.688321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.742513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.761036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba8959-00a1-458b-8ab5-b0f138034150 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.806264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.808829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.808829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.808829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.809319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] RBAC: Adding query filter params (role.id=c937b50f403345129308873cb7c1ee19, user.id=41dff8a36beb42cb9b58adfb2764d8ca, scope.system=all) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:48.809625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.811451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.821949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373262c-5e64-4b14-9c0f-7c3a99f592ab None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.828958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 180/364] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/role_assignments?user.id=41dff8a36beb42cb9b58adfb2764d8ca&scope.system=all&role.id=c937b50f403345129308873cb7c1ee19 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.834077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.870275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.871029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.871432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.871727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.873023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.874589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.876542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 185/365] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.877616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.903941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.959115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8651bd-5d6d-4708-8046-2ca63848bdc9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.997722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd1c1-c0e2-4557-ba9d-6a5cda7ce7e4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.001776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658022a-603d-486c-823f-42732401101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.002645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658022a-603d-486c-823f-42732401101f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.003076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658022a-603d-486c-823f-42732401101f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.003494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658022a-603d-486c-823f-42732401101f None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.004814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658022a-603d-486c-823f-42732401101f None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.006537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658022a-603d-486c-823f-42732401101f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.008278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 181/366] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.009256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658022a-603d-486c-823f-42732401101f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.027699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.040911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=d2e70b37f9f34682862278cc31b4db12) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.046580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.052003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 186/367] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.052740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.141839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658022a-603d-486c-823f-42732401101f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.186315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.186975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.187259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.187533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.193622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.216576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3f8aa-92ec-4fb8-b782-9a16895358af None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.262508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.262508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.262508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.263337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.264419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.265861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.269592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 187/368] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.270292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.274123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.275758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.294164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.396776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225bd6e-4a5b-4651-910f-f85420b28876 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.414355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 182/369] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:49.415365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.447658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.448617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.449370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.449868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.461535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:49.466482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:49.467388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 188/370] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:49.472249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.485308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.528519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc169-dda8-4f92-a2f8-e2aad0d35cc1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.542313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.564802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.565516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.565803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.566078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.566875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.567479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.568608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.575998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 183/371] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.576697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.587242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7a5c1-78a0-4350-a4b9-ee9691cced74 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.641805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.643614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.644533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.645082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.646206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=d2e70b37f9f34682862278cc31b4db12) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.646688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.649447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.658208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 189/372] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.659396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.704323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946953-7c7c-4785-a2f8-88ec8c733898 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.756485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.757775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.758829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.759926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.760475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.764082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.765748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.768946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 184/373] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.775883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.806026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b8b33-a729-40ed-9d96-fe22b41809d3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.840672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.860305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.861927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.862415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.862932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.863813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.864341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.865927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.886615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 190/374] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.887772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.946930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fec1-1a2d-4581-b2ff-3103b352f875 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.014990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.015750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.015914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.016183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.018591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.020072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.026822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 185/375] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.027680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.075859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7faaa1-4ab4-4742-a35b-670ee92e2abf None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.126266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.127545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.128055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.128415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.137423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.223209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca043bf-50f7-4aa6-a401-a873d83d58a0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.236820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.238508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.249497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.296488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.297111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.297389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.297656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.298390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:50.298865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.300940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.316232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 186/376] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.380442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 191/377] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:50.386364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.498815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d75852-2e8a-48ec-b3d6-917681d4f90b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.536491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.537132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.537413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.537694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] PATH_INFO: `/v3/projects/fbef91a083854958a533ab27d1be6c95` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.538854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] RBAC: Authorizing `identity:get_project(project_id=fbef91a083854958a533ab27d1be6c95)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.540288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.542191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 187/378] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/projects/fbef91a083854958a533ab27d1be6c95 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.547845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.590409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.659631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b8057-9d82-42e5-9f07-8b97c97b223c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.695726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.696366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.696647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.696920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] PATH_INFO: `/v3/groups/bf4811e56ad34bea81592c2890190d6a` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.701851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] RBAC: Authorizing `identity:get_group(group_id=bf4811e56ad34bea81592c2890190d6a)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.703347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073b2a-cf54-4999-b3cc-8a367bafc6db None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.705331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 192/379] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/groups/bf4811e56ad34bea81592c2890190d6a => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.711113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.760159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.817304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8d3d0-bb8b-4731-85b2-781472c530f2 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.854004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.854648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.854933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.855204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.855941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] RBAC: Adding query filter params (group.id=bf4811e56ad34bea81592c2890190d6a, role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=fbef91a083854958a533ab27d1be6c95) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:50.856251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.857666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f601e-1465-4bea-9029-630e9e22b9c5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.864736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 188/380] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/role_assignments?group.id=bf4811e56ad34bea81592c2890190d6a&scope.project.id=fbef91a083854958a533ab27d1be6c95&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:51.223798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2777a-6e73-484c-be76-ec6471c6cd4e None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.224293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2777a-6e73-484c-be76-ec6471c6cd4e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.224293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2777a-6e73-484c-be76-ec6471c6cd4e None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.225896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 193/381] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:51.231683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.232148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.232222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.254319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:51.255531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:51.334022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 189/382] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:51.635998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2777a-6e73-484c-be76-ec6471c6cd4e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.759897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2777a-6e73-484c-be76-ec6471c6cd4e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.761944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.801413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.802405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.802981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.803455 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.820423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:51.830820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:51.831705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:51.832616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:51.835293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 194/383] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:51.842467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.891521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.953152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3ad34-1783-4a17-ae7c-cbe72d561a48 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.993135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.993809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.994095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.994366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.995064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:51.995368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.996728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8520c7-9478-4f86-96cd-8eff773d0321 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.005525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 190/384] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.015532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.132605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a1bc-9700-43f7-b165-13f06a527673 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.133067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a1bc-9700-43f7-b165-13f06a527673 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.133444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a1bc-9700-43f7-b165-13f06a527673 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.134968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 191/385] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:52.139978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.140368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.140748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.167073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.168433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.190397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e85ec-6c68-44dc-9760-188e4bde68be None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.240090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 192/386] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:52.290507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.291160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.291450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.291722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.295108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.296554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2106349-c851-45f8-88be-84ff7f94f932 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.298499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 195/387] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.305487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.331347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf798-63b0-4386-940b-083f7266f530 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.331666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf798-63b0-4386-940b-083f7266f530 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.331911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf798-63b0-4386-940b-083f7266f530 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.333496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 196/388] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:52.338633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dcc7-5629-4675-bfec-5948fdd2ab57 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.338926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dcc7-5629-4675-bfec-5948fdd2ab57 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.339208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dcc7-5629-4675-bfec-5948fdd2ab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.356713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.383549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b075dcc7-5629-4675-bfec-5948fdd2ab57 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.384771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b075dcc7-5629-4675-bfec-5948fdd2ab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.427398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f38ff-68d3-4823-9b7d-0dba43bdaedf None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.431176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.464924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.465567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.465853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.466191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.467359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.468807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.470784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 193/389] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.476066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.522647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 197/390] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:52.612370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178642bf-4ce1-4c41-9b0e-dc052d639d7b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.613031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178642bf-4ce1-4c41-9b0e-dc052d639d7b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.613511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178642bf-4ce1-4c41-9b0e-dc052d639d7b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.616457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 198/391] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:52.621137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.621647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.622145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.624864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.629288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f7ed-d550-462d-bd76-dd662aaf5d6a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.643206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.644667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.667730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.669208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.669975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.670506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.673886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, group_id=cbad6518cfa34f0fa533c5cb64b49c49, role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.676188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.722755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 199/392] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:52.722755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.752874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 194/393] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 30 14:36:52 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:52.800736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.830738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.849761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e87f0-d4b2-4b2c-8d83-5489202993d8 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.908207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.909301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.909788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.910330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.922571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:52.929873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:52.930909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:52.931703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:52.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 200/394] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:52.941788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.995279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf2eb-becf-41ed-9c72-0dbb12de82c4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.040588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.041628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.042467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.042971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.056054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:53.061319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:53.062207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:53.063049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:53.065781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 195/395] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:53.066926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.074489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d2ba-0b06-4015-9b34-5a510c487428 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.089894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.115867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.116399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.116686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.116962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.117636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:53.118035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.119376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.129807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 201/396] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:53.134543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.147535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.187614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce567118-1641-442a-bc72-95196cefb631 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.227456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.228141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.228429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.228698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.239607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:53.244447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230d47-7d4e-4398-9d8e-87af9667e755 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:53.244799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:53.246058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:53.247305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 196/397] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:53.249247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.280302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.280914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.281292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.281569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.282341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:53.282718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.284453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.293007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 202/398] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.332355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.353890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c10f-cc7c-4e61-b154-8d9278038f7e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.374759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.390012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.390676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.390957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.391227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.393079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.394547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.400615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 197/399] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.400615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.411749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100dddb-c93d-4dee-9289-8e8a88c3c58e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.449816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.450417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.450721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.450991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.451652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:53.451952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.453301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30090e-b352-467b-893d-8fa6c67a71bb None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.462318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 203/400] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.463782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233b87-989e-4d4a-9886-ec7419af6ae0 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.464067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233b87-989e-4d4a-9886-ec7419af6ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.464339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233b87-989e-4d4a-9886-ec7419af6ae0 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.465644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 204/401] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:53.470137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de233b87-989e-4d4a-9886-ec7419af6ae0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.506507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d72f2-d0e5-4977-a261-29810e04a962 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.541431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.542489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.543521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.543521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.544429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.545990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.553375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 198/402] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.553375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.569591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.583605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de233b87-989e-4d4a-9886-ec7419af6ae0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.621406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.622297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.622606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.623435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.624809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.627537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5be3-3a84-4605-a902-8ef69310b12d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.633891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 205/403] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.633891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.633891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.633891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.641209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.653379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:53.654760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:53.659258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21991-ac5d-493f-9028-f760672a4351 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.701164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.701854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.702137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.702407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.703564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.705176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.711446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 199/404] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.711446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.731813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 206/405] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:53.733018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.814835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.835489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa188f-9b0a-4cbc-b47c-cad288ed2bbd None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.853467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4625c-616f-47a4-bc96-817e9ce0640a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.872284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.873240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.873732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.874262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.875861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.878271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.880490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 200/406] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.881595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.893216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.893945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.894272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.894575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.897190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, group_id=cbad6518cfa34f0fa533c5cb64b49c49, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.898937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.904337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.975879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 207/407] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 30 14:36:53 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:53.983367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.007000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f667-3169-43c6-837d-ff282e4d36da None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.059134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.060354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.060649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.060927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.062435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.064810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.066780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 201/408] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.068169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.094084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.122311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff943e-a867-4462-86ff-850774bb3276 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.164803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.165480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.165761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.166034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.168015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e70b37f9f34682862278cc31b4db12, group_id=cbad6518cfa34f0fa533c5cb64b49c49, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.170193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.201140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb1b0-7d4b-4485-9a41-cf4706828b22 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.237650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.238270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.238575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.238853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.249592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:54.255279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:54.256223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 202/409] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:54.257699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.273530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 208/410] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 30 14:36:53 2022] PUT /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:54.274821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.398382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.425660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.460854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afcd-8ffb-4855-ac84-0d7659ae312e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.465266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8f41-0baa-4cda-b476-ef2cf96a135d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.498959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.499598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.499877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.500174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.500998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:54.501298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.503678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.505038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.505944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.506427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.506963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.510630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4ed7869434e758a32b99358f3ffbe, group_id=cbad6518cfa34f0fa533c5cb64b49c49, role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.512334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.514687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 209/411] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.520527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.581942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 203/412] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 30 14:36:54 2022] PUT /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe/groups/cbad6518cfa34f0fa533c5cb64b49c49/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:54.644564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8bbd5-0cbd-41c4-8d49-783fb8658381 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.663924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.693357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.694024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.694309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.694676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] PATH_INFO: `/v3/groups/bf4811e56ad34bea81592c2890190d6a` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.699415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] RBAC: Authorizing `identity:get_group(group_id=bf4811e56ad34bea81592c2890190d6a)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.700989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.702941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 210/413] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/groups/bf4811e56ad34bea81592c2890190d6a => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.709197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.845145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb12-a307-480e-a225-c0830b7d5b61 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.881295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.882163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.882640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.883074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] PATH_INFO: `/v3/projects/fbef91a083854958a533ab27d1be6c95` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.884336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] RBAC: Authorizing `identity:get_project(project_id=fbef91a083854958a533ab27d1be6c95)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.885932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a6ead-a9e4-4200-b86b-3b01b2e18897 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.888028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 204/414] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/projects/fbef91a083854958a533ab27d1be6c95 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.894248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.936321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977a7b-01fd-4ec8-939f-dc06549728d6 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.936621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977a7b-01fd-4ec8-939f-dc06549728d6 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.936790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977a7b-01fd-4ec8-939f-dc06549728d6 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.938229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 205/415] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:54.944585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.945136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.945685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.960540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.966926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:54.968448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:55.040065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c816-6def-43dc-b2b3-d7c06342db0d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:55.085833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 206/416] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:55.108325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:55.109339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.109833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.110316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] PATH_INFO: `/v3/projects/fbef91a083854958a533ab27d1be6c95/groups/bf4811e56ad34bea81592c2890190d6a/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.115725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] RBAC: Authorizing `identity:create_grant(project_id=fbef91a083854958a533ab27d1be6c95, group_id=bf4811e56ad34bea81592c2890190d6a, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:55.117478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:55.211367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 211/417] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 30 14:36:54 2022] PUT /identity/v3/projects/fbef91a083854958a533ab27d1be6c95/groups/bf4811e56ad34bea81592c2890190d6a/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:55.466757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:55.589459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940622-002e-49bc-b1a8-4a1367068a14 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:55.640488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:55.641444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.642620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.643363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.649307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:55.658133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:55.663431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:55.674046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:55.675166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 207/418] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:55.675858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:55.728990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:55.785255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb66e-2160-4882-bbeb-29ab7eff051c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:55.831095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:55.831628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.831910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.832181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.832866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:55.833169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:55.836724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:55.849639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 212/419] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:55.855155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:55.993343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf74b-1d03-4664-9775-69b7430d8f2c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.038041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.038688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.038975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.039301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.102789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.109063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.111360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f85a5-c8a6-4497-84ac-25c0750caaac None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.218031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 208/420] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:56.219474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.334621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2190-ca4d-41fd-95af-83516273aca9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.338146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91413-f676-4efa-b3e9-6bd5c132cd5e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.338433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91413-f676-4efa-b3e9-6bd5c132cd5e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.338749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91413-f676-4efa-b3e9-6bd5c132cd5e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.340207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 209/421] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:56.345840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.346359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.346679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.346966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.375657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.376746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.377242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.377725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.379106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.384087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.387010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:56.391717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 213/422] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:56.393268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:56.408422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.492248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 210/423] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:56.572273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3934-bb63-485e-8529-e1cfa522aa79 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.617274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.618303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.618836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.619343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.625161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.625161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96343c-2f44-4f2f-a6c3-6822a9956051 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.628855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 214/424] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:56.630252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.667190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.711181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aca39-8b2c-45ba-8501-b74f854795fc None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.711752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aca39-8b2c-45ba-8501-b74f854795fc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.711752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aca39-8b2c-45ba-8501-b74f854795fc None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.713070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 215/425] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:56.718234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469829e-42b3-429f-b7fa-d7c9baaede24 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.718544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469829e-42b3-429f-b7fa-d7c9baaede24 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.718825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469829e-42b3-429f-b7fa-d7c9baaede24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.754090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed15439-12ee-4899-a1a6-7f4328e70f43 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.759549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c469829e-42b3-429f-b7fa-d7c9baaede24 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:56.760741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c469829e-42b3-429f-b7fa-d7c9baaede24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:56.789239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.789853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.790191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.790487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.791233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=d2e70b37f9f34682862278cc31b4db12) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:56.791546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.792984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.806628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 211/426] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:56.855230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.901174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 216/427] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 14:36:56.953939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.051886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.061573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacab5a-eed0-447f-ad19-430a354350ba None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.071107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7856-7c6a-421b-ab8c-650ea9559e4c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.071277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7856-7c6a-421b-ab8c-650ea9559e4c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.071525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7856-7c6a-421b-ab8c-650ea9559e4c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.076565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 217/428] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:57.078952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.079916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.080788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.100862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:57.102593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:57.106428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.107102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.107387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.107664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.123284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:57.131678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:57.132603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:57.133571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 212/429] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:57.138359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.194569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 218/430] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:57.227059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.273193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9cbcd-49fb-4854-84a1-97712a796674 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.316341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.316954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.317237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.317513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.318188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:57.318515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.319896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.334685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 213/431] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:57.335687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.347623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3908b-f0a7-43d6-ac68-b74b3eef743f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.349354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.352422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.382808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.383475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.383760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.384063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.395634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:57.400575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:57.401641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:57.402428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 219/432] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:57.407239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.450398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc48c7e-d057-43fb-83e4-f28c9f1a2ea7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.488716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.489713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.489713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.489996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.514035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a5259-1ffd-431f-b6a9-0e4a854078e5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.547827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.548619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.549109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.549676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.550339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:57.550670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.552020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.562478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 220/433] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:57.562478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.570327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.571938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.586591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.588300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.663985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909132-c4c7-4118-b10b-3f7e37af8ee9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.687848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 214/434] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:57.689311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.711453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.712769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.713276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.713769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.725194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:57.730079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:57.731000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:36:57.731793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 221/435] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:57.732459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.806343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ea819-8f71-491a-a12d-d1b5c702e05e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.822037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.831762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.844749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.845884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.846171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.846437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.848710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e612b-e30b-4537-ba69-336825f8a4fb None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.883129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.884390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.884688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.885311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.886774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.888219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.895794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 222/436] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:57.895794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.919012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.920504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26762b-6268-4606-b5fe-847b5d7d0db9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.004936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c9cf-66a1-4c7f-936c-826cdde34437 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.029271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 215/437] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:58.030577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcb0f-5292-4018-8c0a-222a58371ada None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.030878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcb0f-5292-4018-8c0a-222a58371ada None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.031145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcb0f-5292-4018-8c0a-222a58371ada None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.033152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 216/438] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:58.034072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abcb0f-5292-4018-8c0a-222a58371ada None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.045070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.045674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.046039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.046315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.047015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:58.047315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.048742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.051090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.062380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 223/439] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.062380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.074093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.154162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abcb0f-5292-4018-8c0a-222a58371ada None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.163825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffea8f-4f99-493b-b6fe-c5b787caa8d2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.191913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.192544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.192828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.193102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.194232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.195705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f651e1-7d71-4b6b-970a-6e74db41f1cf None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.197423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 217/440] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.200149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.200663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.201068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.201288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.201899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.202181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.202464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] PATH_INFO: `/v3/projects/d2e70b37f9f34682862278cc31b4db12` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.203624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e70b37f9f34682862278cc31b4db12)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.205566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.207212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 224/441] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/projects/d2e70b37f9f34682862278cc31b4db12 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.207975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.223854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:58.225241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:58.290382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.299958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 218/442] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:58.300824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.309586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02459c-3606-4cbe-a819-3cb92bf30cc3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.322904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.355898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.357188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.357481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.357761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.432640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f883-6f1f-4ada-a3cb-03382b726392 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.444161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.445649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.470664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.471270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.471547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.471819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.472640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:58.472948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.474375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.482857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 219/443] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.483673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.549957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.576341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 225/444] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:58.584431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.607038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.635623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2870bd-3ee7-4356-8840-da44fa3aa791 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.673286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.673924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.674497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.674759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.675899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.677375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.679129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 220/445] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.679726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.710511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59664-06cb-494c-a2c9-2feb82e37914 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.743977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.744597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.744880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.745152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] PATH_INFO: `/v3/projects/c6d4ed7869434e758a32b99358f3ffbe` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.746265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] RBAC: Authorizing `identity:get_project(project_id=c6d4ed7869434e758a32b99358f3ffbe)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.747731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.749349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 226/446] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/projects/c6d4ed7869434e758a32b99358f3ffbe => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.750107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.786086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac60435-b44f-42c4-bc18-e288c95ac4cb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.801388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.822009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.822671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.822953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.823226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.837774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:58.843179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:58.844109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:36:58.845025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 221/447] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:58.845991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.848895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.858804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436b547-4cd7-4972-b405-d4ccb31d2b6d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.893602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.894534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.894812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.895081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.895811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=ad1f9d6de73c449aaa5e73d7b1d320b1, scope.project.id=d2e70b37f9f34682862278cc31b4db12) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:58.896117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.897531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.903413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 227/448] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=d2e70b37f9f34682862278cc31b4db12&role.id=ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.904136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.956964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e1a3-3e9b-487a-aaaf-d03e78c4171c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.996497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.997153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.997438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.997720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] PATH_INFO: `/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.998931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] RBAC: Authorizing `identity:get_group(group_id=cbad6518cfa34f0fa533c5cb64b49c49)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.000406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.007732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 222/449] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/groups/cbad6518cfa34f0fa533c5cb64b49c49 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:59.008950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.030216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3dbc8-f066-4ea7-a8df-15541373327b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.046288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.071743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.072292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.072578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.072849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.073534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:59.073843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.075273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.085706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 228/450] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:59.091688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.093822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.135512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6684-ae35-465e-baca-6ab67ddb3780 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.171429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.172060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.172340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.172611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.174002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] RBAC: Adding query filter params (group.id=cbad6518cfa34f0fa533c5cb64b49c49, role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=c6d4ed7869434e758a32b99358f3ffbe) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:59.174600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.176047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.184909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 223/451] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/role_assignments?group.id=cbad6518cfa34f0fa533c5cb64b49c49&scope.project.id=c6d4ed7869434e758a32b99358f3ffbe&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:59.209022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb517-f99e-41f9-9915-769d5c8238a5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.249888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.250552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.250842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.251188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.304139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.329473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.331084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.434250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 229/452] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:59.440319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.544953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7df3f-d465-4f6e-9b92-e10a5bc8833e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.578232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.578902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.591227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.591227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] PATH_INFO: `/v3/projects/fbef91a083854958a533ab27d1be6c95` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.591227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] RBAC: Authorizing `identity:get_project(project_id=fbef91a083854958a533ab27d1be6c95)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.591227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.591227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 224/453] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/projects/fbef91a083854958a533ab27d1be6c95 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:59.591650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.669647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.693656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0d01-c3d5-49b0-a0be-7e8bcb2ac511 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.727121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.727748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.728028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.728297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] PATH_INFO: `/v3/groups/bf4811e56ad34bea81592c2890190d6a` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.729372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] RBAC: Authorizing `identity:get_group(group_id=bf4811e56ad34bea81592c2890190d6a)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.730851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ab04b-a023-43b3-bd8b-2e4bb7900f83 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.732389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 230/454] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/groups/bf4811e56ad34bea81592c2890190d6a => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:59.739033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.741917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.836171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2a3be-110c-4f79-aa3a-e93a18cd3978 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.868212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.868752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.869035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.869310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.870037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] RBAC: Adding query filter params (group.id=bf4811e56ad34bea81592c2890190d6a, role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=fbef91a083854958a533ab27d1be6c95) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:59.870348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:59.871805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae7ee1-ce54-421f-a857-555b4b531bee None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.878405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 225/455] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/role_assignments?group.id=bf4811e56ad34bea81592c2890190d6a&scope.project.id=fbef91a083854958a533ab27d1be6c95&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:02.288887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a2ba-5565-44c4-8400-a2bff1e750d3 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.289815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a2ba-5565-44c4-8400-a2bff1e750d3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.290263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a2ba-5565-44c4-8400-a2bff1e750d3 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.292041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 231/456] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:02.296946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b24ad-e0ae-461c-b8fc-6944feb6945a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.297785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b24ad-e0ae-461c-b8fc-6944feb6945a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.299241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b24ad-e0ae-461c-b8fc-6944feb6945a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.327454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-da7b24ad-e0ae-461c-b8fc-6944feb6945a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:02.329197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-da7b24ad-e0ae-461c-b8fc-6944feb6945a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:02.336622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f678-de45-41ef-9c8b-49d3451666c3 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.337157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f678-de45-41ef-9c8b-49d3451666c3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.337601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f678-de45-41ef-9c8b-49d3451666c3 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.339416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 232/457] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:02.353625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6401c-7da4-460d-ae1e-c8f14ada620a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.353912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6401c-7da4-460d-ae1e-c8f14ada620a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.354190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6401c-7da4-460d-ae1e-c8f14ada620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.383015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-acb6401c-7da4-460d-ae1e-c8f14ada620a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:02.384231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-acb6401c-7da4-460d-ae1e-c8f14ada620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:02.442811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.460475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 226/458] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:02.502752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 233/459] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:02.566215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23807c5-7056-4c2d-b1c2-25385ecc6eba None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.566424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23807c5-7056-4c2d-b1c2-25385ecc6eba None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.566953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23807c5-7056-4c2d-b1c2-25385ecc6eba None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.568786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 227/460] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:02.573609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.574118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.574637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.607423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:02.608954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:02.695330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 234/461] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:02.746701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23807c5-7056-4c2d-b1c2-25385ecc6eba None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.886823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23807c5-7056-4c2d-b1c2-25385ecc6eba None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.926331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.932923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.948832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.949522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.949803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.950070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.971847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:02.974692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:02.994802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:02.995816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:02.996684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:02.996684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:02.996684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:02.996684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 228/462] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:03.010085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.066338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.068318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc58a6-910f-4af7-a9cc-54a9f077b73b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.109943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.111373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.111825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.112243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.122514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.123943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.126760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351130-6435-45c4-adf0-f16334fbf3f5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:03.139182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:03.140071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:03.140993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:03.140993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:03.140993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:03.140993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 235/463] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:03.140993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.168183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.168798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.169081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.169351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.170000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:03.170307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.171706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abd7bf-ba53-4cc5-810c-7f21df07005c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.184544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 229/464] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:03.185745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207fb9-5036-4735-9eca-8f7cd55d6bb9 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.186035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207fb9-5036-4735-9eca-8f7cd55d6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.186313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207fb9-5036-4735-9eca-8f7cd55d6bb9 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.187567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 230/465] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:03.188940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1207fb9-5036-4735-9eca-8f7cd55d6bb9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.208411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.253875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8938f-7e2c-4e59-8f1f-ac1f2c2b1cc3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.291614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.292260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.292617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.293072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.305015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.305505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1207fb9-5036-4735-9eca-8f7cd55d6bb9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.306484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.317602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:03.323354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:03.324241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:03.325769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:03.325769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:03.325769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:03.325769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 236/466] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:03.325769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.349954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.350638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.350973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.351246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.351893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:03.352191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.353554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b053a8-5c82-4811-ac43-1206d9eab113 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.366096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 231/467] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.367266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.367552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.367845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.386148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:03.387388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.443693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0c57a-a56e-4fba-aee4-7d232fa3435c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.453734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.458498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 232/468] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:03.458498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.507131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.508527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.509275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.510027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.511423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.514325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.582005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.585861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37518-b77f-42aa-bc41-d1234f942035 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.619603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.620206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.620482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.620746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.621442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:03.621745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.623122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.642594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 233/469] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.642594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.644019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 237/470] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:03.648940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.791029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0baec-4155-49db-8dae-32d22de07e21 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.810716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e635-a706-451e-80cd-649ed0bfb74c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.842304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.842957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.843348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.843525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.844217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.846546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.852539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.853149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.853430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.853703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.854352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.856057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ca47-61b0-4d19-a3e6-9cd100a0932e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.946776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 238/471] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:03.947624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.959205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 234/472] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/users => generated 246 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:03.960451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902fc9-9b3c-4262-9b0b-3c483814cad8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.960741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902fc9-9b3c-4262-9b0b-3c483814cad8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.961013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902fc9-9b3c-4262-9b0b-3c483814cad8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.966384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 235/473] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:03.970725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.971087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.971275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.991726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.013001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:04.014313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.041324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.134963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700470b5-5eb2-4e2f-be99-616a6911b641 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.156728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 236/474] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:04.179051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.179972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.180399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.180844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.194931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.196382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:04.214510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:04.215460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:04.216332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:04.216332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:04.216332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:04.216332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 239/475] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:04.222259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.347223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7fbb0-28a8-46bf-9fae-7fab8a3d3d43 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.403118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.403733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.404012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.404282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.404938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:04.405241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.406708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.424349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 237/476] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:04.430203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.457074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.462665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.512264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.541884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43552ae4-6a5c-49fa-9475-37a2b90eac66 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.578676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.579790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.580066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.580334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.580986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.582414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.633148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a741b5-31cf-4bf1-af47-db5fa357ab06 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.668575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.669180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.669460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.669731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.670402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.671930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.709751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.sql.core [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:04.709751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:37:04.709751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [parameters: {'id': 'bba54fa4adc0411d9d0c676b9ad94a03', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:37:04.709751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:04.727233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:04.728141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application yield resource Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise self.value Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application session.commit() Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:37:04.729080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:37:04.729953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:04.730862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:04.731719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [parameters: {'id': 'bba54fa4adc0411d9d0c676b9ad94a03', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:04.732521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:37:04.733339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.734203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 238/477] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/roles => generated 144 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:04.742041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.778604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 240/478] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/users => generated 249 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:04.828681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.867585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdcfe-11e2-4f3f-b01f-73250e89145d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.910795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.911473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.911759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.912040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.929874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4b3168ec-5200-4a2b-83ae-e7094e7fc32f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:04.935421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:04.936339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:04.937157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 239/479] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:04.943307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.096458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9571eb-091e-4214-a089-c36c2b71982e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.122099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.131166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.131783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.132062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.132330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.132993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:05.133349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.134793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7f1f1-d359-4ba4-8711-33021c50e411 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.144525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 241/480] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:05.923086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6aaf-6630-4d1c-9067-9959c5a8f25b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.923621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6aaf-6630-4d1c-9067-9959c5a8f25b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.924230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6aaf-6630-4d1c-9067-9959c5a8f25b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.926573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 240/481] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:05.931877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ccd98-17b3-4da2-ba6a-1485be74eae8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.932297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ccd98-17b3-4da2-ba6a-1485be74eae8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.932486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ccd98-17b3-4da2-ba6a-1485be74eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.951323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c82ccd98-17b3-4da2-ba6a-1485be74eae8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:05.952506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c82ccd98-17b3-4da2-ba6a-1485be74eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.051754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 242/482] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:06.250012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d62ad7-4f11-4b5e-ac00-9ff0d59f6803 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.250350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d62ad7-4f11-4b5e-ac00-9ff0d59f6803 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.251465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d62ad7-4f11-4b5e-ac00-9ff0d59f6803 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.253136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 241/483] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:06.257997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.258292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.258595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.283408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:06.284600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.354695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 243/484] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:06.366854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d62ad7-4f11-4b5e-ac00-9ff0d59f6803 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.472550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d62ad7-4f11-4b5e-ac00-9ff0d59f6803 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.500490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.509144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.509783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.510066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.510375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.525772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6c6001b0-f284-416e-bbad-52e263e65c74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:06.530812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:06.532010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:06.532827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 242/485] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:06.537988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.608526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.633668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbb5a-ed51-407a-b006-f9d2cc26ceb9 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.633975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbb5a-ed51-407a-b006-f9d2cc26ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.634228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbb5a-ed51-407a-b006-f9d2cc26ceb9 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.639706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 243/486] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:06.647577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.647934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.648138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.673934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:06.675344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.753156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccb853-38d5-4489-abf0-704f264e174f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.788174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.788788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.789067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.789338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.790003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:06.790303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.798498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.810327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 244/487] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:06.811308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.816826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 244/488] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:06.817698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.987853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856686c2-a6d5-416f-b27d-3eedb40d0850 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.019837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.076379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771e7-358a-4b15-9306-cf663486989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.090140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771e7-358a-4b15-9306-cf663486989e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.090140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771e7-358a-4b15-9306-cf663486989e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.090140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771e7-358a-4b15-9306-cf663486989e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.111361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339771e7-358a-4b15-9306-cf663486989e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:07.126470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c79e49-e5e7-4075-bcec-aa7f8f0534d7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-339771e7-358a-4b15-9306-cf663486989e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:07.127094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.127973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:07.128819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 245/489] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:07.133643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771e7-358a-4b15-9306-cf663486989e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.147736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.166677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.167697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.168180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.168654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.180326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.182112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:07.212446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.213428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:07.214296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:07.214296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:07.214296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:07.216458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 245/490] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:07.222660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.337345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0d5e7-1b66-4136-80bb-e9f2c2bc7362 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.380933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.382023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.382557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.383054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.383945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:07.384061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771e7-358a-4b15-9306-cf663486989e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.384555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.386322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.396150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 246/491] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.397255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.419993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.420988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.421418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.421842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.433628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.438245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:07.446542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.464051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 246/492] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:07.465022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.492311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.515921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a480c-b91a-45f5-8645-3f375d3d4ae6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.554374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.555249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.555714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.556085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.556983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:07.557319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.558824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.577688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 247/493] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.577688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.590692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa6f47-95ae-4db2-bc71-365016371598 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.625438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.626418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.626735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.627014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.637417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.638901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:07.652954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.653887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:07.654915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:07.654915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:07.654915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:07.654915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 247/494] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:07.654915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.679145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.687333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ea7bc-6fd6-4945-8b28-3fbd775c5aaa None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.720753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.721533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.722179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.722477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.723201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:07.723511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.724880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd4045-c1e6-4e80-a0c3-e3fdd767c598 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.732531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 248/495] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.733686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d0bb-4ff8-4258-9672-d806cbc65a1f None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.733971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d0bb-4ff8-4258-9672-d806cbc65a1f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.734248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d0bb-4ff8-4258-9672-d806cbc65a1f None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.736457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 249/496] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:07.737735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b923f-3e38-47a8-941f-ba841f6dfa59 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.737735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b923f-3e38-47a8-941f-ba841f6dfa59 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.738022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b923f-3e38-47a8-941f-ba841f6dfa59 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.739223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 250/497] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:07.739917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b923f-3e38-47a8-941f-ba841f6dfa59 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.748963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.764774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c04b3-3421-4c0c-998b-084430fcc8cc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.799944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.800570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.800849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.801118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.807953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.809396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:07.824988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.826143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:07.827315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:07.831358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 248/498] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:07.832293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.845337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b923f-3e38-47a8-941f-ba841f6dfa59 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.879099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.879700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.879979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.880249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.880886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:07.881185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.882584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ad21b-ecf6-48c0-b1d1-6f20616256d7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.894113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 251/499] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.895345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770b97d-83bd-4cdf-8526-6b37dd1f1a38 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.895632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770b97d-83bd-4cdf-8526-6b37dd1f1a38 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.895911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770b97d-83bd-4cdf-8526-6b37dd1f1a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.914164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c770b97d-83bd-4cdf-8526-6b37dd1f1a38 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:07.915437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c770b97d-83bd-4cdf-8526-6b37dd1f1a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:07.925285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.933273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cef11-20a7-46de-9473-814eac87dfb5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.967844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.968530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.968815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.969159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.980374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.981810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.982888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 252/500] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:07.984112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.984399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.984679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.999973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.003270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:08.004468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:08.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:08.017260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:08.018138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:08.018138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:08.018138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:08.018138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 249/501] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:08.018502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.080452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 253/502] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:08.081295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.137030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8344-6a68-4993-81a5-e5544a7a4c43 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.176863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.178410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.178724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.178999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.179735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.180039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.181476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.182769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.214555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0bc1b-9f82-427e-9820-70f2118e778a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.225862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 250/503] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:08.226953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.259548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.260187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.260472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.260745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.268103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.269553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:08.282926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:08.283929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 254/504] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:08.285271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.289433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.334948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e5804-c95f-461d-99d2-3b45e7f1a1c9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.372459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.373069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.373352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.373634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.374287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.374630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.376582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.388322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 251/505] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:08.389060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.392557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3722-ad7d-4207-a441-50ae0adef455 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.427269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.427882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.428171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.428450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.431067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.487848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f91-3068-472a-9c66-0945039591c6 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.494988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.496456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.501945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.521161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.525675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.525675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.525675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.532173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.533623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:08.549302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:08.550342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:08.551262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:08.551262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:08.551262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:08.551262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 252/506] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:08.551262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.596179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 255/507] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:08.597047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.631954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.692794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399abc2-e1a0-4ffc-bd62-146d96dbee4a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.696824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b7e58-c6e1-417c-a2c6-d269220d601e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.725228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.725831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.726121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.726507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.727260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.727570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.729006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.730917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.731546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.731831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.732107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.742402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:08.745824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 253/508] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:08.746647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:08.747394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:08.748322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 256/509] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:08.751959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.772436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.843707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.850694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4b86-cde3-4dec-a605-6d83c8a1ff35 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.856564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9f76-d54e-42ad-99ed-6012f47fb773 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.884397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.885000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.885211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.885322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.885539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.885836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.886119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.886210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.886392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.886501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.887847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.893414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.894858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.899248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 257/510] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:08.900035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:08.907949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:08.908843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:08.909759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 254/511] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:08.910905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.996386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.997555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915d1ff-8bab-40ea-88bd-fd2929a36fa0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.011701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88133-b8a9-40cd-ba58-4fc07a512a50 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.030387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.031050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.031333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.032160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.042516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.043955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.046154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.046778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.047059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.047980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:09.059414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:09.060387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:09.061233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:09.061233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.061233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:09.061233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 258/512] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:09.061233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.070060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.116509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.117959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.161695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df118e9-6c0a-4b66-94bf-49b7304f376f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.194070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.194700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.194959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.195234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.195893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:09.196193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.197399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.197574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.205281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 259/513] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:09.206144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.216709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 255/514] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:09.217752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.272606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.306173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d33c5-abcf-47f0-9d56-a23a5a8c7b57 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.315356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338284a0-7d43-4de4-8c8b-66148acfd568 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.340733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.341334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.341612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.341883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.342563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.344036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.348833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.349440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.349724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.349997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.350773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:09.351082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.352550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.369328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 256/515] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:09.370202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.412686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.458278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 260/516] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:09 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:09.459137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.466811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce76fe-d9f6-41b1-9c83-6167660a9c1e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.504791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.505423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.505713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.505980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.506677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:09.506979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.508411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.527067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 257/517] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:09.527067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.575000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5ca79-f037-43c0-8db8-8da38d4aa322 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.603087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.617081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.618061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.618346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.618843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.632115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.633648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.640790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ab6a-55e9-4abc-8a44-9f40870d89dc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.644459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:09.650417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:09.651396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:09.652326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:09.652326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.652326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:09.652326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 261/518] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:09.652554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.685309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.685956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.686435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.686772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.698221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.699678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:09.715151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:09.716250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:09.717304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:09.717304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:09.717304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:09.717304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 258/519] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:09.717587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.762300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65672d9-c35a-465e-8974-75d822367aee None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.797310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.798065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.798347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.798898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.825363 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6f7b-2213-4686-8b13-76c6de4090b8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.851101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.867623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.868247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.868583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.868857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.874532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.876207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.876614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.877735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:09.890416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:09.891926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 259/520] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:09.892816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.909556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.989511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 262/521] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:09.990374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.999099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e351-1abf-42d6-8264-b241fa684989 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.034003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.034655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.034906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.035179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.035820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.036125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.037492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.049224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 260/522] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.049900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.076459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.101024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb447c9-3892-4f86-a3b2-52fbb108c88f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.128919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.137684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.138293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.138600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.138880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.139525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.139826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.141989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.158296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 263/523] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.158296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.158606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005290fa-9741-4d86-bf99-1f7c56f6edc4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.191712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.192411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.192702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.192979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.193675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.193984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.195529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.213727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 261/524] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.214584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.266913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60e46a-ad75-4335-8bcc-dd5e59cc3795 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.305265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.305919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.306261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.306727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.309987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.318328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.320259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.322043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc42b-f47e-4cd1-bf4c-7dec9f1c7c2b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:10.334737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:10.335870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:10.337004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:10.337004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:10.337004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:10.337004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 264/525] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:10.337004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.363905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.364534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.364813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.365085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.367133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.372984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.374417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:10.386752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:10.387770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 262/526] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:10.389324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.452224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f54c-5ae2-4edf-a615-b72533b1fe79 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.488579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf14f1-b902-4696-a47b-622e99e4446f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.491127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.491875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.492260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.492638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.500785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.502656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:10.515558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:10.517201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:10.518250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:10.523883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 265/527] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:10.523883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.529052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.529733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.530084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.530423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.531247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=914aa57ca54b416080fec74e374bac86) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.531891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.533377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.538915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 263/528] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/role_assignments?user.id=914aa57ca54b416080fec74e374bac86&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.539696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.592283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.620280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.657582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699415f3-6689-4aa5-b7e0-8640bcbf8ee5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.682122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d2e3-10a7-4aa6-8047-c8174d477b3e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.699446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.700450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.701205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.701706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.702782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.703314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.706372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.724612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.724612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.724612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.724944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.725686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.725784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 266/529] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.725856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.729105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.729234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.751789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 264/530] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.752664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.859156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb711-d8da-4ca1-9a29-d6a1a85a8659 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.870212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.880323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d6a7-e0c9-49ec-aaca-487fe62205a3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.898427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.899298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.899726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.900171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.901011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.901463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.902062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.904200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.922653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.923844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.923949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.924229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.926469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 267/531] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.927508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.937741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.940190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:10.954090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:10.955170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:10.956079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:10.958121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 265/532] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:10.959231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.062057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbae7a-5e40-4044-8c15-a42945ff36f7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.077930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fcbf-3f27-4375-86da-aa4eadd4eab0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.106391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.107073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.107599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.107881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.119463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.120344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.120844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.121414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.122357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.122993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.124629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.133087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 266/533] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.134234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.172989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.217179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.247695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.249206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.340068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da64e-148a-4718-99e2-650afa9e37af None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.385561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.386617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.387081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.387543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.388412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.388893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.390695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.405089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 267/534] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.411334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.418060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 268/535] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:11.426768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.530697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.559291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.562723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fe36d-d601-4a42-befd-7a341a5f99a1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.568679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c7f2-59a1-4814-8a5e-e88e3537f0a3 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.604216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.604787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.605078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.605357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.606330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=4a4ef96940de44a0a565e313f2ec7e8e) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.606688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.606901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.607852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.608531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.609026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.609209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b4fad-2bcd-48f6-9775-1b06be8da839 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.618002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 268/536] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/role_assignments?user.id=4a4ef96940de44a0a565e313f2ec7e8e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.619934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460d67-18dd-4de0-b8a3-a49191f16755 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.620237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460d67-18dd-4de0-b8a3-a49191f16755 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.620521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460d67-18dd-4de0-b8a3-a49191f16755 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.627145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.627344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 269/537] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:11.629702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.632474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.632783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.633065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:11.664971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:11.665953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:11.666871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:11.666871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:11.666871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:11.670474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 269/538] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:11.673012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:11.674632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:11.675753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.824625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 270/539] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:11.879569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29831b0e-d735-497b-be02-a29d76d86e63 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.907654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.926799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.927351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.927638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.927914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.928567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.928874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.930297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.942901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 270/540] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.951512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.079406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:12.087211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f8fc-a4fa-461a-bbba-456b76bfbeaf None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.114915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.131161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.132143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.132618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.133084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.141209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.143106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:12.155344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:12.156207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:12.157786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:12.160297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 271/541] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:12.166617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.278047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b90b8-7c4c-4151-b8f1-18966bcfc21e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.313500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.314144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.314429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.314734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.325108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:12.330684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:12.331569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:12.332367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 271/542] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:12.337580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.340169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa895b-7289-4960-845a-0cff991f5eca None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.383484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:12.430343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.431006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.431340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.431614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.432371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:12.432684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.434115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.444011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23422-f17c-482d-9938-aa5a890f8860 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.463931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 272/543] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:12.470012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.481733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.482356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.482681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.482959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.483636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:12.483944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.486004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.496263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 272/544] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:12.504757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.510717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:12.678251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd328c4-4461-4360-90da-53d3b991c432 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.699528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee0f-eb4e-46b5-958e-d1063e54f5b2 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.702739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:12.745579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.746334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.746642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.746919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.747656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=507ab70c63db42ffb6c77c02c58d1f37) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:12.747966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.749387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e54a8-508f-4b45-bd9d-39d19edf4baf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.762054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 273/545] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/role_assignments?user.id=507ab70c63db42ffb6c77c02c58d1f37&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:12.764132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.764854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.765211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.765587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.778320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.779952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.784785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862b45-c46c-4691-a34b-7b3cdd175867 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.785275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862b45-c46c-4691-a34b-7b3cdd175867 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.785710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862b45-c46c-4691-a34b-7b3cdd175867 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.787541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 274/546] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:12.793135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.793632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.794067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:12.799665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:12.800850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:12.801887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:12.801887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:12.801887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:12.808000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 273/547] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:12.809350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:12.837209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:12.838381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:12.936892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a6ee-7524-4b34-9146-feda85a17f60 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:12.976717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:12.977256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 275/548] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:12.978103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.978646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.979149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.980022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:12.980544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:12.982107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:12.999771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 274/549] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:13.001394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.020862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.118237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb285d-8236-4583-9dbb-154152f6180a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.164719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.165428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.165718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.165997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.179549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.180997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:13.196162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:13.197082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:13.197995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 276/550] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:13.205106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.244225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.289191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.316713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4723b-6698-471e-93c0-18735c61860e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.352638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.353599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.354106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.354604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.355650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:13.356175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.357902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.397107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 275/551] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:13.403584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.426830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.495236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088d8c-d52e-45f0-a760-0dc8ac914638 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.531997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.532634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.532910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.533173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.544295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:13.550862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:13.551807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:13.553104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 277/552] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:13.558809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.559539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.600814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31e704-e9a1-4ddc-a239-8301ca7071d8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.636789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.637559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.637899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.638234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.661655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35bfb-5420-4aeb-ba86-e4d5aec2d835 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.689900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.697901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.698535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.698814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.699083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.700415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:13.700415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.701789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acd9d6-bc73-40f6-b655-0b759218c59b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.713906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.715031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 278/553] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:13.716037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99555359-e59c-4f03-95b7-47cda19bae53 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.716454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6fe4-b2c7-46da-84d5-239e2130ec3c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.716752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6fe4-b2c7-46da-84d5-239e2130ec3c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.717024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6fe4-b2c7-46da-84d5-239e2130ec3c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.718535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 279/554] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:13.720193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d6fe4-b2c7-46da-84d5-239e2130ec3c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.799307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.841098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 276/555] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:13.841098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.841098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.841098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.841448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d6fe4-b2c7-46da-84d5-239e2130ec3c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.857483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:13.858733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:13.885826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.886945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.887699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.888431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.900675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.902114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b5952c57-bbe2-459c-9d0c-639c1b583903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:13.920060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:13.921078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 280/556] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857931-5bac-4238-b20b-a949b068c8a1 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.923571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857931-5bac-4238-b20b-a949b068c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.923934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857931-5bac-4238-b20b-a949b068c8a1 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.926627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 281/557] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:13.926627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857931-5bac-4238-b20b-a949b068c8a1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.938895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 277/558] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:13.939747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.984058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.050760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857931-5bac-4238-b20b-a949b068c8a1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.075352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c29303-0cdf-4278-bdc6-fa8428572460 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.077067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.090473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.091411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.091897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.092308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.105707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.107886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.115708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.116544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.116929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.117302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.118060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.118907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.120205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-9a9cff1c-640f-48ba-bb9f-8c4955101988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:14.126839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.128120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:14.129005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:14.129005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:14.129005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:14.130578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 282/559] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:14.131908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.132361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.132791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.138352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 278/560] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.139365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.152565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:14.154093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:14.229781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 283/561] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:14.231024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.258596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.267303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b3f2-5e48-4ea8-b24e-fdd923a7fe30 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.304645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.305174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.305456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.305728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.306369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.306699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.308330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.321321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 279/562] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.323214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.354676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.360683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cc916-2342-4a86-88a5-b5704ab51751 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.397005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.398007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.398517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.399014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] PATH_INFO: `/v3/users/glance` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.407694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.409495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:14.421505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.423873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:14.424829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:14.431650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 284/563] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:14.432761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.434199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103380c-a7c1-40f8-acb0-f18e49443a31 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.470665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.471300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.471582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.471897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.482365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:14.487912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.488888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:14.490338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:14.493896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 280/564] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:14.494769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.531138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.548095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecdac-22c2-4cdc-b1de-11e06311003f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.584060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.584724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.585010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.585620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.589285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.593028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.595344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:14.606844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.612283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 285/565] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:14.613191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.616049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c6e-a8ce-4ccb-a948-c827e26c2daf None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.653117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.653802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.654056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.654327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.655103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.655405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.657676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.675990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 281/566] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.676820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.723397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f53b9-0d61-4991-b07a-c9b249c8ab8b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.760047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.760655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.760932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.761211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.761867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.762164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.763552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.772461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 286/567] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.776973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.781979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.786986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aa9b2-0134-4034-8b20-b13e70dca0a9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.832534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.833190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.833473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.833747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.841968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.844879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:14.849766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.855140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 282/568] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:14.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.883404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8cd3-af25-4b3b-bbcf-54ba9e5736d3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.919767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.920370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.920649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.920917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.921607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.922583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.924376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.936910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 287/569] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.937973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.973856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67777903-9b32-41d4-ac97-6949282a7862 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.010149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.010340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.010918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.011688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.012015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.022033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.023520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:15.038553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.039531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:15.040424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:15.040424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.040424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:15.040424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 283/570] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.040424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.053579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee459-886e-4a6f-9c09-de21d02d3401 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.087588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.088222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.088501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.088773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.094253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.099172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.100654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:15.116293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.117237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:15.118151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:15.118151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.118151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:15.118151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 288/571] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.118151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.146042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a818d-522e-4446-9ddc-c6368128ee90 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.179659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.180328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.180621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.180897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.181567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.181874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.183266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.191274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 284/572] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.192073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.217123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f167-3b97-4f54-b2a1-942463df4433 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.234274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.250924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.251526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.251803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.252079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.252799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=bb6314f7ac7e45b99d46d3e8a480150e) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.253107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.254593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddb1b1-cf95-41f7-9c2c-ec6419188f58 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.259749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 289/573] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/role_assignments?user.id=bb6314f7ac7e45b99d46d3e8a480150e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.260875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bce3c-0018-4f23-b25e-3578457fdf76 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.261157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bce3c-0018-4f23-b25e-3578457fdf76 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.261429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bce3c-0018-4f23-b25e-3578457fdf76 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.263596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 290/574] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:15.263596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bce3c-0018-4f23-b25e-3578457fdf76 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.303255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fea9-b80c-4b8b-8b04-eaa354349050 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.320226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.343727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.344511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.344736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.345083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.345749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.346056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.347568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.361500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 285/575] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.362371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.397111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bce3c-0018-4f23-b25e-3578457fdf76 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.432546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.433159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.433445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.433719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.434362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.434695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.436054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370151-d583-4c9a-b45e-31bcda66e53c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.448822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 291/576] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.450113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.450402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.450711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.469459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:15.471364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:15.476813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1ec5-84b8-47fd-8e10-acd591573923 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.510417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.514360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.515030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.515803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.515803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.526048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.527544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.542391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 292/577] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:15.542590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.543956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:15.544905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:15.544905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:15.544905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:15.544905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 286/578] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.544905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.546361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.594621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.672559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803add-ff41-4c20-a579-45ffc261e079 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.713805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f76829-4a09-4b5a-b901-f92d1b291415 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.721028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.721887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.722893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.723436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.732658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.735544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:15.751163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.752082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:15.752965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:15.753741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.754720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.755096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.755419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.755776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 287/579] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.756693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.765391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.766947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:15.783163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.784307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:15.785426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:15.789090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 293/580] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.789906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.839568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.869710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.884556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5017b84-2b55-4ff0-bf29-0765e658b261 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.915222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5532ab-cb49-4224-bace-421d6cc84572 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.920036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.920767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.921148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.921517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.923322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.923735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.925194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.936962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 288/581] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.937918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.955004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.955608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.955886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.956150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.956832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.957136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.958605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.976214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 294/582] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.977074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.047629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4cec0-3fdf-4ce6-8932-8a7250985ec1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.074730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.084135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32b4d-cf2e-4290-a486-4edd73ce48b7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.084725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.085631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.085932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.087061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.087393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:16.087815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.089809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.116284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 289/583] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.117179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.120672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.121242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.121524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.121620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.121795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.132362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:16.137243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:16.138178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 295/584] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:16.139076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.226571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ddd93-a6d9-42b4-82d9-fbf1bef36b59 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.255073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fe4ee-be9c-4891-917c-14c4a176d1d2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.260562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.261196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.261474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.261740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.269598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.271132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:16.283644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:16.284656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:16.285636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 290/585] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:16.286237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.295265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.295662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.295941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.296211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/914aa57ca54b416080fec74e374bac86/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.312708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=914aa57ca54b416080fec74e374bac86, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.314411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.353479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.391246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a7fb-9dbf-4a90-81d8-02584b8ed5df None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.406130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 296/586] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:16 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/914aa57ca54b416080fec74e374bac86/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:16.407222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.409803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.443878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.444629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.445240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.451766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.461074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.463357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:16.482109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:16.489297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:16.490359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:16.490359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.490359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:16.490359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 291/587] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:16.491664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.533007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a454-29d1-4001-bcfd-5e4688c6b3b8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.574692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.575675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.576153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.576635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.577607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:16.578764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.580355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.589242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 297/588] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.590766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.636769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17394d-e58f-4510-8c53-cb029308c227 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.656753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.667570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.675484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.676404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.676883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.677352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.678305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:16.678857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.680497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.700134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 292/589] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.706325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.709888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e3b7-025b-4675-8f44-03c7b0d7582c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.748152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.749292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.750530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.750826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.751590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:16.751895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.753382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.766415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 298/590] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.767297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.842416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf674-e11a-4aaa-9c0c-7916bd0ce05c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.881505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.882388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.882734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.883008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.895295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.896608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.898546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105446-a17a-4d29-b15d-108b8b39290f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:16.912910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:16.914062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:16.915126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:16.915126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.915126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:16.918595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 293/591] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:16.919559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.926726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.938567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.940003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.940003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.940003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.951081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.952530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.953982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:16.971982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:16.979557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:16.980506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:16.980506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:16.980506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:16.980506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 299/592] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:16.980506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.037160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c101-a83e-4324-a325-e1ffd2882716 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.083264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.084273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.084738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.085247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.093144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.094966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.095924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf4cd-99bf-48c5-bcbe-172bcaa650d7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:17.107756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:17.108685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:17.110099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:17.112289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 294/593] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:17.113468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.132407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.133045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.133280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.133550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.134185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.134509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.135964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.153200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 300/594] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.153200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.188010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.216027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.231143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f07ce-0227-4a77-a735-3c1a7f77cad0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.257632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c3481-2769-417a-820c-c5a7c0aa8da1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.266499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.267107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.267380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.267661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.268301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.268603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.269962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.281816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 295/595] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.282640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.297893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.298792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.299082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.299359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.300059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.300369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.301807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615298b2-78ac-4755-b112-fb1cb78eef40 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.313926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 301/596] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.315126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1081-e092-498a-9a51-57825c88c111 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.315412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1081-e092-498a-9a51-57825c88c111 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.315682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1081-e092-498a-9a51-57825c88c111 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.316988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 302/597] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:17.317513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f1081-e092-498a-9a51-57825c88c111 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.393112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c70027-81d9-4689-ac51-0ae7658eda99 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.417765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.425709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f1081-e092-498a-9a51-57825c88c111 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.428579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.429197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.436826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.436826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.436826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.438419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:17.451154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:17.452109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 296/598] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:17.453053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.463284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.470157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.470849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.476946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.476946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.479036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.480498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-71762357-fc3b-4bf4-8e9e-970f04d21ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:17.492428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:17.493339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:17.494230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 303/599] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:17.494810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.495214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.495214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.513423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:17.514679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:17.563150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ac8d9-e8fd-42ac-9f7d-4080b7b24a6d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.584733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 304/600] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:17.585634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.617217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.618472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.618982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.619695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.641772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=36f965f6675e44c3921178931ae00caf, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.644710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.683409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.698490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75503c-33e6-4612-9d8c-33c778e6f5be None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.711348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 297/601] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:17 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:17.712593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.737365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.738004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.738331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.738644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.739395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.739701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.741333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.773135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 305/602] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.778770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.788589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.846198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32caa-d86a-4048-9de5-ea3aa9c507c7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.888138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.889152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.890227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.891382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.892634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.893166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.895325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.912576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 298/603] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.913797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.948722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fee89-b374-45fe-a536-9804df4768d5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.988395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.989415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.989896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.990392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.002700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.006330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:18.019461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:18.020433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:18.021354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:18.021354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:18.021354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:18.022098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 306/604] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:18.022478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.039571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a9e6-d75e-41f7-976b-ba0bd627f6b7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.058189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.078291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.078959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.079460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.079739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.102863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:18.111059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:18.112031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:18.112881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:18.115740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 299/605] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:18.117185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.143972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05cd0-6c4b-41e6-818a-4e1a7faf252e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.183579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.184483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.184940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.185397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/4a4ef96940de44a0a565e313f2ec7e8e/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.201323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=4a4ef96940de44a0a565e313f2ec7e8e, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.203128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.239328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343e28-366a-4b83-863b-c5b0b1287562 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.274731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.275347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.275630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.275911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.276559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:18.276863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.278223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.294488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 300/606] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.294488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.309344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 307/607] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:18 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/4a4ef96940de44a0a565e313f2ec7e8e/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:18.312912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.370537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.396643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.480967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0cc5-e866-4e93-a41d-f8eb4daca940 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.514280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfeb7c-3685-4037-8518-a8a9dad4b24f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.531532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.532661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.533359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.533791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.534697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:18.535143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.537406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ac653-ae76-411f-9be0-4dba4fe6dd83 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.552454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 301/608] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.553878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0ef4-0d8b-422a-95e7-825f66e662ac None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.554490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0ef4-0d8b-422a-95e7-825f66e662ac None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.555830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0ef4-0d8b-422a-95e7-825f66e662ac None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.558034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 302/609] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:18.559192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0ef4-0d8b-422a-95e7-825f66e662ac None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.560350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.561142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.561670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.562046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.571503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.572956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-36f311d4-247a-4f82-9ea2-019e3d57dcc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:18.586659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:18.587580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:18.588499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 308/610] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:18.589473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.589473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.589740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.612477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:18.613838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:18.696100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.700597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0ef4-0d8b-422a-95e7-825f66e662ac None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.706543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 309/611] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:18.707715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.746799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.747442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.747723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.747993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.765518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.767109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.771341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:18.799641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:18.800633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:18.801524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:18.801524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:18.801524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:18.801524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 303/612] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:18.808521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.893770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6523d-109a-4980-8172-eae23aa91589 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.937201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.937952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.938259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.938554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.939260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:18.939565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.940989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.971323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 310/613] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.977080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.011213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2db1-1218-4985-98e8-7cdc0e6eb9cd None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.063477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.064095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.064535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.064818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.066048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:19.066362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.067770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.084336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 304/614] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:19.085711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.100122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.109312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924c63-67d4-4e3a-9f94-df20801b1eff None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.118807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.143953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.145681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.146483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.146981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/507ab70c63db42ffb6c77c02c58d1f37/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.162621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=507ab70c63db42ffb6c77c02c58d1f37, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.164391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.202512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26855d-b7ae-40a8-a09e-c2023c61b9e6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.235084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 311/615] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:18 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/507ab70c63db42ffb6c77c02c58d1f37/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:19.236447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.238373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.239120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.239459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.239792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.253502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:19.259118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:19.260137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:19.260975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 305/616] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:19.277314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.375681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca021c-06bc-4755-999d-7006a57ea1ed None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.421076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.423711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.424198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.424917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.435224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.436453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.439827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:19.457266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:19.463532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:19.464476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 312/617] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:19.465069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.477232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.478877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be16b7b-47d4-46f1-a1b9-98fb03850045 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.535200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.536215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.536870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.537368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.538246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:19.538828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.540433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.560805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 306/618] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:19.580003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.587876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bfce-ff15-404a-be04-2f0a66439492 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.628378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.629122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.629409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.629677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.630467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:19.630745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.632324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.653922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 313/619] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:19.661127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.733481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.777501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2c68-2c36-4cb3-a66f-1dd3efe35840 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.818770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b523e-189a-4eaa-80d4-c9c6d243c0dc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.831430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.836917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.837356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.837773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.857675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.864085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.878045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.879113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.879544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.879982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:19.892975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:19.893964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:19.894889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:19.894889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:19.894889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:19.895059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.895834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.897447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.902914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 314/620] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:19.911470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:19.918348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:19.919489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:19.920390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:19.920390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:19.920390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:19.923403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 307/621] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:19.929858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.042554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d797c-326f-4e75-a07f-e675055e3f74 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.063435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b0c9-cba8-40d3-85cf-06531f24c71c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.078936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.079490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.079835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.080112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.080771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.081077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.082022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.083277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707bfb-bd79-494c-bde7-6cc55da78b60 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.099741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 308/622] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.099741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb532b-6da5-4d54-a899-7299d1cf044b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.099741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb532b-6da5-4d54-a899-7299d1cf044b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.099741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb532b-6da5-4d54-a899-7299d1cf044b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.102654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 309/623] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:20.103619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb532b-6da5-4d54-a899-7299d1cf044b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.106666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.107492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.107948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.108426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.109821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.110300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437488d-c426-4d0f-92f6-5ca68420b7c9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.131766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 315/624] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.133375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.133860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.134304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.152974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:20.154573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:20.162789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.223789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb532b-6da5-4d54-a899-7299d1cf044b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.232895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 316/625] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:20.234804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.317418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.318184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.318569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.318923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.347338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.348830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.352451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de084ead-1038-4449-8fd0-6e67004f8966 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.361576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:20.383773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:20.384844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:20.385804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 310/626] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:20.395026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.397722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.398903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.399377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.399834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.409082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.411350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:20.425184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:20.426112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:20.427056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:20.429732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 317/627] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:20.435840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.548302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76923688-0a00-47ce-9776-1f028618a785 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.595075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.595809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.596192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.596543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.597314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.597746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.599244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.609945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2b93-80f6-4361-84d1-dac59b5ced61 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.612994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 318/628] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.613525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.613822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.647246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.647430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.648134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.648497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.648841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.649619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.649909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.651381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c43f2a-b649-4078-83dd-f5149a05f868 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.670245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 311/629] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:20.673229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0eaec-bcb7-428a-bacd-5cc4870dcf8f None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.673621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0eaec-bcb7-428a-bacd-5cc4870dcf8f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.674002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0eaec-bcb7-428a-bacd-5cc4870dcf8f None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.675799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 312/630] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:20.677431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0eaec-bcb7-428a-bacd-5cc4870dcf8f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.727326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd41e9e-bb1b-4c31-9dc9-c705efcc4ba0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.764064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.764695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.765030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.765333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.775495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:20.780815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:20.781898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 319/631] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:20.783525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.789559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0eaec-bcb7-428a-bacd-5cc4870dcf8f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.830594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.832527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.832962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.833400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/bb6314f7ac7e45b99d46d3e8a480150e/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.849813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=bb6314f7ac7e45b99d46d3e8a480150e, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.851823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae1de6-c770-452c-9db4-04afa78c55aa None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.879636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.893666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56192-1946-4b9b-a180-9e7f71286bb0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.938486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 313/632] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:20 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/bb6314f7ac7e45b99d46d3e8a480150e/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:20.938751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.938751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.938751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.938751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.939076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.939076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.939076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.961250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:20.962978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:20.982847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.035087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.037697 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.070609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 314/633] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:21.074888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.150525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.168055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 320/634] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:21.174664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.203302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0fcaf-3f6e-4935-b79b-fb03b9ee011d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.241182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.241970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.242159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.242573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.243317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:21.243685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.245131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.253656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 315/635] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.259520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.290836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.296880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf877-7742-47ef-945a-e5f71ef7c80b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.347226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.348111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.348576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.348999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.370955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.373660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-5fe071e4-f53c-49e3-9265-61397c36cf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:21.403073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.404656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:21.406421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:21.406421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:21.406421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:21.409413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 321/636] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.411258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87a75-0bab-45c4-8645-72f4473e10a2 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.411981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87a75-0bab-45c4-8645-72f4473e10a2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.412434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87a75-0bab-45c4-8645-72f4473e10a2 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.414346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 322/637] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:21.415274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d87a75-0bab-45c4-8645-72f4473e10a2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.436948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27924c-7985-419e-a418-60e450fecd24 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.467199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.472673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.478031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.478031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.478031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.486768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.488298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-05597470-b8cc-4940-a7bd-89a870bddc0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:21.503537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.504720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:21.505811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:21.505811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:21.505811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:21.511267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 316/638] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.512300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.512589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.512866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.533255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:21.534413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:21.537307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d87a75-0bab-45c4-8645-72f4473e10a2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.572078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.572825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.573205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.573571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.574328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:21.574744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.576222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.586617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.589883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 323/639] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.590774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.610525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 317/640] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:21.610525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.713436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbea05-3806-4a1a-97c7-88540c01f666 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.723395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.729574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fff88f-58eb-4148-9521-e759c03d895d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.748880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.750025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.750303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.750595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.751289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:21.751595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.753009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.765565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 318/641] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.766438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.776504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.776903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.777220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.777498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.788307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:21.793323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.794240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:21.795128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:21.798819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 324/642] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.799836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.826219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.898722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ddfd5-ce7e-4d3c-97e3-5056218ba61c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.920305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe001a-9abc-46d7-9b49-a7edf07839b0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.934265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.935014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.935357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.935636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.943127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.944561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:21.956251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.957388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 319/643] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.958496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.963174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.964043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.964271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.964546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.973654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.975347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:21.987049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.988154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:21.989474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:21.993063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 325/644] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.993888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.017400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.074479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d9e0-da07-4c38-86d9-dfbd90c242af None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.082824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.105090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144e65-f38c-49aa-8639-cae772eb4328 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.115856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.116739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.117291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.117569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.118239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.118722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.120711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.135526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 320/645] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.135526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.140831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.141469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.141751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.142020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.152678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:22.158412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:22.159631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:22.160663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:22.164431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 326/646] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:22.165653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.247504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3efa4-0260-4d51-b6ef-b927afb6d5fc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.250263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.274696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f18d-57ea-49f1-a191-0a1c92c7b79e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.283655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.284280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.284565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.284840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.285538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.285865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.287313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.301583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 321/647] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.302387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.319413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.320014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.320294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.320565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.321299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.321600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.323047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.333097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.340873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 327/648] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.343756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.411017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813506-bbb5-4044-8e61-43296c3cf347 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.447116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.447700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4ed9-aea1-4b0d-a2d8-2258d8f33671 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.448138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.448138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.448299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.459497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.460942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:22.476590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:22.477575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:22.478540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:22.478540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:22.478540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:22.478540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 322/649] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:22.478540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.490954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.491577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.491864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.492139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.492811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.493116 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.494507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.497447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.509030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 328/650] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.509030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.576143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.598684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d45bd-a390-4031-ad66-5d632496a511 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.612671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359efb7-106b-4b08-9490-b6bac92cc774 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.637765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.638652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.639084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.639611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.641692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=914aa57ca54b416080fec74e374bac86) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.642159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.644008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.648834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.649553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.649838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.650108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.651274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 323/651] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/role_assignments?user.id=914aa57ca54b416080fec74e374bac86&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.652285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.748658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.758010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.759589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.787640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117c3b-e4c3-4841-bc8f-92f02cb0f8cc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.842015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.842997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.843998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.844446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.845285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.845767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.847402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.863464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 324/652] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.864650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.870802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.886034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 329/653] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:22.887357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.990650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fdf23-489f-4670-9893-54091c7bd79f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.015975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.020030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a8bf-147d-4755-9360-582d3f7fc3fd None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.029255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.030301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.030809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.031236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.044549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.046862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.055689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.056440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.056721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.056990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:23.063534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:23.064573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:23.066113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:23.066113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:23.066113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:23.066113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 325/654] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:23.066344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.066416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.066512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-70256381-d3c8-45b0-b928-d86f6cb4ec50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:23.078666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:23.079704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:23.080661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 330/655] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:23.081267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbafaa1-c197-49f7-b236-91c1fc5ff112 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.081267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbafaa1-c197-49f7-b236-91c1fc5ff112 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.082210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbafaa1-c197-49f7-b236-91c1fc5ff112 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.082809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 331/656] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:23.083334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbafaa1-c197-49f7-b236-91c1fc5ff112 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.132381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.185964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de82d-d8a0-455f-a918-fadad78c1b02 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.191590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbafaa1-c197-49f7-b236-91c1fc5ff112 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.223019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.223655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.223938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.224211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.227811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.228426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.228712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.228989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.229633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:23.229935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.231336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.237248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.238915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.245478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 332/657] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:23.246117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0116d7e7-4361-4a67-9dba-ff3c1fd5baec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:23.260793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:23.261779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:23.263169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:23.263169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:23.263169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:23.263169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 326/658] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:23.263169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.263460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.263817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.272217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.281952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:23.283179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:23.349451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 327/659] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:23.350357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.370841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bab69-7535-468e-9843-0f9e2ea6b387 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.393709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.413337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.413958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.414239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.414846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.415918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:23.416229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.418127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.442720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 333/660] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:23.443778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.459570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69ed5-526d-49f0-bcf6-7272b63c7e36 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.497777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.498555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.498913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.499282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.506546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.508084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:23.523513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:23.524630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:23.525799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:23.531842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 328/661] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:23.532769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.543310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.575519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557c472-6aaa-4a03-9e07-bfc7f716af9f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.619415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.620590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.620954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.621298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.622331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:23.622725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.624429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.638407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 334/662] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:23.641025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.649991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.657673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767812-e08f-41bd-9959-45aad90b8fc5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.700561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.701178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.701464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.701740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.754688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac8318-0b56-443d-bb31-2c29452d4050 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.777260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.778957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.796520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.797141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.797562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.798089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.798862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:23.799155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.800561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.803221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.825568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 335/663] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:23.826492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.894756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.904291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 329/664] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:23.904291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.937447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01042ec-e5a6-44fe-9809-290565b47647 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.972622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.973830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.973830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.973830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.980579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.982014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:23.993889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:23.994803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:23.995698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 336/665] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:23.996202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.009640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633a80-901d-4c5c-a268-eddffa60a17e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.045552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.046676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.047037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.047368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.056330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.057938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:24.062899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.063850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 330/666] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.064796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.110953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4caf-1fdf-4bef-937c-adc499e6bef6 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.126710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.146288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.150547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.150547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.150547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.169454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843a37e-f9a5-4a9a-bba2-ae1fb4863710 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.207716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.208464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.208900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.209182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.219264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.221266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.222704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.224620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:24.239293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.240288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:24.241228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:24.241228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.241228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:24.241228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 331/667] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.241228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.285219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.332569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 337/668] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:24.333562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.358379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cdcf2-3314-46ff-a846-158273a3dc6f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.371140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.397809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.398457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.398750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.399025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.399778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.400141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.401673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.421909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 332/669] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.423431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.449003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8801-f225-4ed8-b43b-b8cd7d067ae2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.487639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.488235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.488518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.488794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.489465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.489773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.491173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.499512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 338/670] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.500562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.521152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.536433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21364b-7b9a-4df4-bff1-00aa0ae5dc68 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.575847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.576834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.576978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.577815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.578581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.578951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.580385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.597782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 333/671] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.597782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.615952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41d7c-95f9-474f-a77e-e76beb815294 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.627723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.656464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.657097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.657380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.657654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.668197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.669746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:24.690376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.691672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:24.692977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:24.692977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.692977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:24.692977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 339/672] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.692977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.707646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a5ad-00d6-47da-a725-aeb91ed0fb11 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.741572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.742175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.742477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.742767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.743488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.743796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.745216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.751439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 334/673] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.752216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.759209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.800745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131286d-53b2-46a8-ad90-079885c8709d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.852971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.853543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.854085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.854359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.865901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.870344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.872001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.873023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f1c47-774a-4b15-acbd-6aeeb68c223b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:24.888177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.900580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:24.901674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:24.901674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:24.901674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:24.901674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 340/674] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.901674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.915841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.916530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.916818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.917093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.925942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.927467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0efa88ed-7e41-4d29-b3f2-48fd1f50f52d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:24.940173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.941112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 335/675] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0612-245b-409b-bd90-9ae071bacf33 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.943010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0612-245b-409b-bd90-9ae071bacf33 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.943636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0612-245b-409b-bd90-9ae071bacf33 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.945390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 336/676] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:24.945390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b0612-245b-409b-bd90-9ae071bacf33 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.023575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ebf9-5176-409b-96ea-6f87b97f57ae None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.047434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.060223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b0612-245b-409b-bd90-9ae071bacf33 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.064361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.064361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.064361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.064361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.064805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.064805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.064805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.076699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 341/677] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.078066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.101925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.102577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.102859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.103183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.103776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.104080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.105432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71293b9b-93cf-4c67-9142-951b11fce9f7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.117501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 337/678] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.118878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.119163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.119435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.136917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:25.138096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:25.147996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.191705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79714-eae4-40a4-8f54-2488a0068a31 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.206625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 338/679] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:25.207467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.240600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.241830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.243238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.243761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.244669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.245204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.247030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.264290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 342/680] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.266338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.317814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36a50-97f2-41fd-8aa7-9dc954f332b7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.318493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.357045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.358837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.359590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.360295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.369807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.371600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.386154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab622b75-192b-4288-a50f-fc5998ac2d9f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:25.388400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:25.389502 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:25.391414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 339/681] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:25.391931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.400111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.431820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.432718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.433168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.433589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.442058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.443786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:25.456446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:25.457710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:25.458907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:25.461986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 343/682] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:25.463051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.497240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ffa18-0337-42b1-8e9a-a95d919d37cb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.533879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.534668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.535049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.535464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.536276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=4a4ef96940de44a0a565e313f2ec7e8e) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.536775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.538180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.544227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 340/683] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/role_assignments?user.id=4a4ef96940de44a0a565e313f2ec7e8e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.545005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.581590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.586314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb4322-4fe1-482d-bde2-2ab80986ad25 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.639410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.641195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.642037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.642560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.643902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.645044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.645571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.647557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.665240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 344/684] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.666488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.694003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b6f3-be66-4a76-b365-ebd9f9d392dc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.744297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.744905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.745183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.745463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.746200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.746537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.747976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.769180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 341/685] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.770471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.801030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897bc4-e5ec-4460-9075-64f8556a4358 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.851792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.853019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.854051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.854506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.869587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.872075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:25.889886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:25.891064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:25.892135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:25.892135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:25.892135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:25.897312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 345/686] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:25.897312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.903538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a764-9b98-45d7-8822-e93efab91ce2 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.910803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.942222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.953422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.954314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.955289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.955792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.957016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=507ab70c63db42ffb6c77c02c58d1f37) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.957476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.959826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.967786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 342/687] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/role_assignments?user.id=507ab70c63db42ffb6c77c02c58d1f37&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.968783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.057429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527a7-9e08-4d74-9414-fc2dcfa656af None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.127127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.127757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.128045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.128326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.150761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f519-ee3d-4986-aa86-4ab466aec5ec None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.190487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.191214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.191510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.191847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.192507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:26.192816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.194374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.207943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 343/688] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.213445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.213905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.218316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.232706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.275877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.324032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 346/689] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:26.330364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.333355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f196-eed8-4c63-a3d2-3a4adb441a01 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.370836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.371828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.372270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.372711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.373679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.376033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.434118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2d742-e41b-415c-9bc6-003f475c1306 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.447459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.469373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.470020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.470302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.470607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.481458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.482941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:26.499176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:26.505686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:26.506842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:26.506842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:26.506842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:26.507176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 344/690] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:26 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:26.507251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 347/691] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:26.508407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.638989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c71c-019c-4ca6-9266-2111e365aa21 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.648918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.690088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.690731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.691049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.691329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.691989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:26.692298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.693677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d03127-8395-45e7-ac61-6b1778d923b1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.708791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 345/692] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.714412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.844245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e662fe-1a61-470f-bc66-90947a9bada4 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.844550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e662fe-1a61-470f-bc66-90947a9bada4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.844854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e662fe-1a61-470f-bc66-90947a9bada4 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.846432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 346/693] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:26.852008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.852008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.852294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.865700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6b102-c3a7-405e-81b0-a697ec1561d1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.876176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:26.877707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:26.911719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.912898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.913187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.913461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.923649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.925106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:26.939028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:26.939970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:26.940932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:26.943383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 348/694] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:26.950235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.963336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 347/695] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:26.979177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.066731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aff97-745c-466a-9b7c-f4c315ab253c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.105257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.105452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.105654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.105868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.106599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.106909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.108888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.121198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 349/696] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:27.126768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.269612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.273754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.285174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee59c1-dd6c-4e45-9083-d899297d6bd9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.336740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.337738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.338299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.338798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.339776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=bb6314f7ac7e45b99d46d3e8a480150e) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.340282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.341908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.353423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 348/697] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/role_assignments?user.id=bb6314f7ac7e45b99d46d3e8a480150e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:27.396994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.415154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f5d8e-1133-483c-bdab-87f77588ffe6 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.475271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.476314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.476820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.477284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.491720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:27.497234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:27.498244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:27.499684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:27.502168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 350/698] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:27.508419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.615307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31108d-358f-47bf-97b8-8b4922249466 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.651869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.652928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.653443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.653968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.654931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.656231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.657865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.666699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 349/699] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:27.673843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.818101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc029a3-4491-4aed-aa78-be985d9f5ed3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.865860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.866898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.867406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.867894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.878674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.880457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.883312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a201eb7a-3758-4663-b6ac-2ff03dcb3b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:27.896600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:27.897569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:27.898726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:27.898726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:27.898726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:27.898726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 351/700] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:27.904965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.938872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:28.017935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddfa8e-071d-4879-ada5-ceb3fe6ca5bf None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.022663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca187ee-51d1-4cc2-9898-633e15142991 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.022953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca187ee-51d1-4cc2-9898-633e15142991 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.023249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca187ee-51d1-4cc2-9898-633e15142991 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.024920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 352/701] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:28.032558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f542-f34f-44d5-9988-c36bd2d2a421 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.033030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f542-f34f-44d5-9988-c36bd2d2a421 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.033452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f542-f34f-44d5-9988-c36bd2d2a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.068334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3ca8f542-f34f-44d5-9988-c36bd2d2a421 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:28.073240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3ca8f542-f34f-44d5-9988-c36bd2d2a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:28.091129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.092065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.093515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.093943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.095885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:28.096370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.098176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:28.127800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 350/702] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:28.130028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.190124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 353/703] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:28.260227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:28.281092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd30d3-5f02-4b08-8690-66aa16604633 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.319769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.320758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.321253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.321728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.329773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.331582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:28.339158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79eb91-98eb-45d3-adb7-2cd9b90ad70d None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.339444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79eb91-98eb-45d3-adb7-2cd9b90ad70d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.339714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79eb91-98eb-45d3-adb7-2cd9b90ad70d None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.341267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 354/704] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:28.346383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:28.346618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:28.347615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:28.348556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:28.349100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.349100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.354642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 351/705] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:28.357216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.382226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:28.383447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:28.468538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cd34-88d6-4caa-b751-0ea774e6fd0b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.511230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.512419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.512689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.514473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.514473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:28.514473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.516901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:28.520552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 355/706] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:28.538357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:28.546667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 352/707] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:28.552599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.604328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.633852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:28.707135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0fcd2-4cd0-48f0-9187-59fa14bd1763 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.717239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b46d1-114b-4e61-8f39-9ca2b0b62688 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.754810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.755828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.756324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.756929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.757731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.759405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:28.771311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:28.772360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:28.773226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:28.781184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 353/708] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:28.782811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.803181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.803814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.804107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.804432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.852612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:28.894768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e6b-74d1-4beb-8c8f-6abe094bd204 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:28.933761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:28.934806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:28.935354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:28.935849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:28.936862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:28.937435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.939048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:28.948531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 354/709] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:28.950000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:28.971951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:28.973401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.029492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.060974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173cc4e-0753-465f-bf66-2aafb6ec114b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.078501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 356/710] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:29.078501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.098884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.103390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.104153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.104621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.105025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.106009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:29.106406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.107921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.121301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 355/711] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:29.122611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.179784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e2e21-4ff5-470a-a006-3071a7588452 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.223471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.224126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.224403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.224673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] PATH_INFO: `/v3/services/network` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.225271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.227607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:29.249642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:29.250754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:29.251662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:29.253526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 357/712] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:29.260212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.310854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.336516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedbd5-8626-48be-afa6-00f12e7cdec0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.384176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.384975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.385359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.387496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.408313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605c549-8d35-4a89-9ef0-4ad1306bba21 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.409523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.411028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-2919e2d8-00fe-4927-b368-838609e1c5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:29.439367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:29.440404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:29.441981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:29.441981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:29.441981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:29.441981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 356/713] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:29.445380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61125dfa-a81f-4d9e-adef-0e865331e43e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.445670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61125dfa-a81f-4d9e-adef-0e865331e43e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.445948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61125dfa-a81f-4d9e-adef-0e865331e43e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.448191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 357/714] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:29.448903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61125dfa-a81f-4d9e-adef-0e865331e43e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.472839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.473522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.474058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.474336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.475468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:29.475777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.477217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe3d4f-b595-428d-8f3d-4f80d65106f7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.485596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 358/715] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:29.487481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.488024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.488303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.506204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.516909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:29.521053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:29.569324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61125dfa-a81f-4d9e-adef-0e865331e43e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.606481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.607171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.607459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.607739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.608425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:29.608732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.610159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.613893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 359/716] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:29.614862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.632085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.635725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 358/717] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:29.639796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:29.735778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7314-4fea-4e40-b18e-83491660cbf8 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.782141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.782787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.783073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.783345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.783987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] RBAC: Adding query filter params (type=network) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:29.784287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.785653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b80f9-e7d0-460b-af8a-bad625ac208d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.809238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 360/718] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:29.834477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae6c20-a623-43be-a283-ca66d8125f80 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:29.836912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.851696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77db2-b7be-477b-95b9-134f44526ceb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.855325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77db2-b7be-477b-95b9-134f44526ceb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.855325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77db2-b7be-477b-95b9-134f44526ceb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.855325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 361/719] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:29.860016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.860606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.861112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.886267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:29.887415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.887925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.888449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.891298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:29.892844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:29.903630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:29.905422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:29.930485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:29.931470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:29.932387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:29.941324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 359/720] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:29.949724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.005286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 362/721] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:30.006172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.017409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.074087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6f70-90f2-4754-a38c-c8367ab1564b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.118477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8f3bc-82e0-42bb-97b8-77a15b7f7763 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.119417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.120224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.120661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.121085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.121949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:30.122409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:30.124048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:30.155792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 360/722] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:30.156469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.157106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.157387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.157655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.163981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.187214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:30.192284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:30.193215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:30.194072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:30.194763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 363/723] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:30.201518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.222094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.272654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.322239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933353f-63c5-4b6b-a940-cf20efb8871d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.331816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea0368-35d3-42e4-8721-d33cc5af0090 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.368671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.369319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.369622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.369907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.370688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:30.371011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:30.371439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.372057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.372339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.372453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:30.372616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.373276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:30.373925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:30.375324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:30.379632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 361/724] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:30.380472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.384983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 364/725] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:30.395634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.500828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.511055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18256ff4-2643-4ce6-ba41-63420b5e1dde None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.551416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.551986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.552274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.552558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.570353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:30.579773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:30.580735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:30.581596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:30.595638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 362/726] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:30.595638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.616633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17576185-1ea1-4782-ab59-d4722b9d1d76 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.716404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73507262-738e-4935-b35d-eb959e98ea6c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.723917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.737193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.737833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.738110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.738381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.765284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:30.768553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:30.779433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:30.780651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.780930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.781200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.781927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:30.782236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:30.783639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:30.799641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:30.801859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:30.804260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:30.804260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:30.804260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:30.804653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 363/727] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:30.804799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 365/728] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:30.807303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.811092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.833077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.961231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854f69-0c3b-4806-b672-d59683357e63 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:30.993164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3cc19-fc1c-422f-ae47-f284d32c86f4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.035822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.036457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.036738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.037006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.041564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.042175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.042471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.042749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.043400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.043700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.045055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.065641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.067305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.070615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 366/729] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:31.077692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:31.100686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.101704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:31.102636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:31.102636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.102636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:31.106622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 364/730] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.113130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.160906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.234814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.249205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a7d3-be90-4065-b17f-6c40effca4d6 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.290986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.292276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.292790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.293270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.302548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.304258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:31.318495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.319422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:31.320366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:31.323241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 367/731] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.331184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.333540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a88c-7f22-4233-b0c4-61e242584855 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.386704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.387326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.387589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.387870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.388523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.388832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.390822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4eeab-4540-466e-9ef6-6cfa6894011b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.411534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 365/732] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:31.414476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd4f9-0a4d-4428-aaf0-cfe4701679f8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.417643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd4f9-0a4d-4428-aaf0-cfe4701679f8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.417937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd4f9-0a4d-4428-aaf0-cfe4701679f8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.419219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 366/733] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:31.420093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd4f9-0a4d-4428-aaf0-cfe4701679f8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.488017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a1fce-f109-4480-b20f-b9521dc088a8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.490312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.525425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.526572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.527069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.527540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.528461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.529025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.531451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2cf71-90a3-4325-91d7-bb4b7c854779 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.537490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd4f9-0a4d-4428-aaf0-cfe4701679f8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.552261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 368/734] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:31.554040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.554640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.555115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.564141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.581524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:31.581716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.581814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:31.581905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.581905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.581905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.585937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.587778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:31.603031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.609016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 367/735] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.610026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.652594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 369/736] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:31.653503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.719260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba39d7-2806-4a30-a9b2-7fa32b610ab6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.750810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.756440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.757398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.767410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.767410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.767646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890e75-be77-436f-a6c7-5068474afe0c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.799481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.800100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.800378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.800647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.801384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.801689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.803137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.822312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.823896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 370/737] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:31.836721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.852557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.854334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.935866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0404-e161-44fd-bee2-10c44c733460 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.972487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.973104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.973383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.973655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.996145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.022036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 368/738] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:32.027554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.045194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.047584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441d0a-5cc5-4e32-94e0-f6e1c384bce5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.113528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.130008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135421-4d13-4837-bf9b-37830c49db05 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.166437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.167213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.167497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.167808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.179349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.180798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:32.196225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:32.197209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:32.198112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:32.198112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:32.198112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:32.198112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 369/739] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:32.202535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.210024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 371/740] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:32.210024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd48-12b6-4482-b215-90ab58cc832c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.210024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd48-12b6-4482-b215-90ab58cc832c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.210024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd48-12b6-4482-b215-90ab58cc832c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.210024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 372/741] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:32.210437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcd48-12b6-4482-b215-90ab58cc832c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.265866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.314736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e766-5818-4511-8e0b-9346debed0d7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.321626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcd48-12b6-4482-b215-90ab58cc832c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.351726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.352348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.352634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.352913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.353568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.354993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71467ae2-3132-4da0-974b-7c88fe0a586c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.357788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.359117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.359225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.359447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.359720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.360392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:32.360705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.362073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.379655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 373/742] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:32.379655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.474227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618c476-e7a8-44a5-90b1-2d605f005062 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.484001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.494494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 370/743] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/services => generated 251 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:32.499964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.500236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.500513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.524298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:32.525558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:32.535985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.537582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.538052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.538549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.555160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.557416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:32.577882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:32.578940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:32.579841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:32.579841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:32.579841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:32.587110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 374/744] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:32.593062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.623770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 371/745] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:32.638553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.744851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b40c-f3c0-4d57-bea8-ce31cd16a306 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.756242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68a974-434e-48f2-944d-cd83e25533c5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.784311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.788635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.789278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.789564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.789840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.796936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.797523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.797793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.798066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.798838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:32.799422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.801698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a04f55-5b36-464c-a167-a0d92cec781a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.801807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.802312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-4619d9df-bcc2-47b4-a6f0-1b675479a3da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:32.815929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:32.816864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:32.817782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:32.822487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 375/746] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:32.823444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59fc29-1e56-4c1c-95d1-bc60c024725b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.823740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59fc29-1e56-4c1c-95d1-bc60c024725b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.824020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59fc29-1e56-4c1c-95d1-bc60c024725b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.829555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 376/747] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:32.829555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59fc29-1e56-4c1c-95d1-bc60c024725b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.830528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 372/748] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:32.832220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.836736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.836736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.852531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.854378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:32.855718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:32.931028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 373/749] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:32.931627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.964216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59fc29-1e56-4c1c-95d1-bc60c024725b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.001840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.002472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.002768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.003040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.003736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.004062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.005471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.022087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 377/750] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:33.022087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.060665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327532c-0fff-49c0-a565-49a42e29e171 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.078195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.098846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.099556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.099855 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.100131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.107212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.109888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.116111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:33.122701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:33.123964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:33.125094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:33.126275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 374/751] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:33.127257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.148666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d43f0-d3c5-46e7-8212-401299328545 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.189789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.190320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.190634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.190904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.191558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.192917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.253543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a58b4-0358-43c0-91a6-ca839fa41229 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.270471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 378/752] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:37:33 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:33.270471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.316825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.317441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.317721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.317995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.318839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=6b75d4fa3ca04bd69c079295e3fc44e6) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.319179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.320657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.327943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 375/753] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/role_assignments?user.id=6b75d4fa3ca04bd69c079295e3fc44e6&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:33.328886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.430848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.463938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880ff9f-75c6-4ffb-80a0-7df0ff7b2661 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.510039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.510039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.510338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.510624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.511308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.511618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.513165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.515768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaba5b-2b92-4581-aa32-7d488e81db6c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.516501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.527107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 379/754] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:33.532787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.563633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.564758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.565513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.565951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.582861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:33.591668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:33.593777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:33.594815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:33.597222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 376/755] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:33.602821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.688830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513b7a2-cefa-42dd-8049-d4d4561dbdc4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.742570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.743004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.743528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.743899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.744833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=bb6314f7ac7e45b99d46d3e8a480150e) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.745212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.746811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.753520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 380/756] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/role_assignments?user.id=bb6314f7ac7e45b99d46d3e8a480150e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:33.808711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.836834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426490e0-34f1-4442-b414-31c494084e11 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.902711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.903333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.903615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.903890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.904603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.905160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.907018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.921483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 377/757] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:33.923156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.988052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.039644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d3a3-00d7-4b4c-9d8b-b1150dd77d68 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:34.082435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:34.083138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.083426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.083702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.098096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:34.099673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:34.120368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:34.121774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:34.122681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:34.122681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:34.122681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:34.126577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 381/758] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:34.128841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.263027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514de3-1c44-44c9-b7f1-1dc6a89c2574 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:34.311996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:34.312578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.312867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.313144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.313802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:34.314109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:34.315499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:34.340743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 378/759] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:34.347675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.473874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57cf8-bd75-4659-92a8-76b6c9984124 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:34.487404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.512203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:34.515914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.515914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.515914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.522264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:34.523766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0786f607-8ff3-42f7-896c-912832e0cf5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:34.544170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:34.547426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:34.549702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 382/760] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:34.555711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.578358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.681811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f9f51-6a86-4a8e-9a3c-832074333892 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:34.714518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beeccf-2583-4230-b056-f0db0b1f8943 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.715139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beeccf-2583-4230-b056-f0db0b1f8943 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.715632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beeccf-2583-4230-b056-f0db0b1f8943 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.717438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 383/761] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:34.722384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.722936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.723535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.730462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:34.731080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.731366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.731703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.733194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:34.733511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:34.734977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:34.766714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 379/762] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:34.772546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.884909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:34.886123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.946849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.995668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0728-ab91-4e0b-bc91-c43357808ff0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.023016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 384/763] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:35.041912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.042764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.043191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.043608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.060365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.062030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:35.087236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.088378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:35.089477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:35.089477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.089477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:35.091237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 380/764] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:35.097292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.238836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5e49b-d8ba-4947-a15f-a1a52d95e3d4 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.241016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.291166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.291789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.292077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.292354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.293005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.293311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.294696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.308495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 385/765] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.313261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.443118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd623c-ab92-420e-84ce-0b520e31e62f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.468616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.477605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.478243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.478554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.478823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.486342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.487804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:35.499592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.500508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:35.501435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 381/766] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.511582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.639478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.642393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2c06d-933f-4e8d-a64b-8b3275d68ae9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.703939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.704918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.705408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.705900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.706829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.707341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.708982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.732277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 386/767] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.738722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.783144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.837418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715095dc-bc8e-429b-b812-a0a1dff910d5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.875606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.876402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.876991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.877485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.878283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.879678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-b016baef-7c4a-4b79-a4e8-f9c07b9a09fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.888620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.889904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:35.890766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 382/768] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.891571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1345-4ecf-433a-9d96-7c680a70ac56 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.891571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1345-4ecf-433a-9d96-7c680a70ac56 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.891818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1345-4ecf-433a-9d96-7c680a70ac56 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.893167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 383/769] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:35.894051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf559f-999f-4048-abb1-5f616c869763 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.894337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf559f-999f-4048-abb1-5f616c869763 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.895138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf559f-999f-4048-abb1-5f616c869763 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.899979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 384/770] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:35.899979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf559f-999f-4048-abb1-5f616c869763 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.906752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99f68e-79df-4af1-9ff1-a4873bda4e4c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.944880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.945647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.946322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.946707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.948811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=36f965f6675e44c3921178931ae00caf, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.950333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089e0be-7172-4854-aa7e-0627ecae1d64 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.954725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.005345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf559f-999f-4048-abb1-5f616c869763 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.013464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 387/771] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:35 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:37:36.015035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.015552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.016004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.037245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:36.038874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.060961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.061594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.061884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.062225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.062919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.063234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.065332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fff23-1364-4843-b666-62e7acd28408 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.071465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 385/772] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.072991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c211-f999-4eb7-b161-be07829f2930 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.073680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c211-f999-4eb7-b161-be07829f2930 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.073962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c211-f999-4eb7-b161-be07829f2930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.098372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d771c211-f999-4eb7-b161-be07829f2930 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:36.100163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d771c211-f999-4eb7-b161-be07829f2930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.124118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 388/773] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:36.125060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.148248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.192166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 386/774] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:36.193753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac5b7-1455-4d9d-be1d-8f9d45fe032c None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.194044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac5b7-1455-4d9d-be1d-8f9d45fe032c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.194320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac5b7-1455-4d9d-be1d-8f9d45fe032c None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.195723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 387/775] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:36.200833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.201116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.201596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.231839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:36.231839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.254940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750944f-6c78-42fb-bdc4-9e3d305bf07d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.266464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.295932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 388/776] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:36.317437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.318416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.318946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.319434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.320372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.320888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.322529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.328658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 389/777] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.334833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.478591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b931e-8ac5-4dd9-b500-7a4008b0c016 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.483981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.527699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.528680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.529193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.529860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.531091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] RBAC: Adding query filter params (interface=public, service_id=4920c492b67547149119c39e7de91de9, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.532721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.535892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.547988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 389/778] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/endpoints?service_id=4920c492b67547149119c39e7de91de9&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.549714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.600419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.603220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.627855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318f88-f07a-49c5-bdda-8886e3f8369a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.663794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.664805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.665328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.666110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.675824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181156a-a8fa-40b0-bb3f-0170023ea746 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.677356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:36.682226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.683177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:36.684034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 390/779] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.684728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.714819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.715451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.715733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.716005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] PATH_INFO: `/v3/services/network` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.716590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.718533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.727658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.728749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:36.729600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 390/780] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.730403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.800083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6363-8329-4ee6-bc3b-c3030fcee579 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.833642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.834307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.834627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.834905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.835516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.836875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.838606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.839943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049e45-aa0a-4165-8497-9a7254b81178 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.842407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.850886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 391/781] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.852637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.892145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.892770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.893058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.895153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.914120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:36.924160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.925185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:36.926020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:36.933105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 391/782] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.934206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.995950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea40d-ca5b-48cf-8edb-80ee9c4d9b6c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.036712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.037337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.037620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.037893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.039255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.039361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.040691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.049978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 392/783] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.054523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.065201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31699-c4f4-4a91-8ad8-c482e4d48f1a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.111051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.111994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.112544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.112824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.113601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] RBAC: Adding query filter params (name=network) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.113928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.115568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.122568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 392/784] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.123093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.123918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.162732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.169554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248942db-4ef5-4691-aad0-e83b4a5ddb39 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.205778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.206425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.206791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.207067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.207747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.208053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.209422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.219051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 393/785] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.220415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.257982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617cf1-740a-4339-9509-9e8e87a44461 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.294880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.295535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.295962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.296242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.307132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.308530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:37.330008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.331246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:37.332338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:37.332338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.332338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:37.334592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 393/786] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.335580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.356276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914b30-d3a4-40af-8b3f-e7b702fd28e8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.380721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.395100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.396176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.396512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.396786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.397855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] RBAC: Adding query filter params (type=network) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.398215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.399939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.407832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 394/787] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.409282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.438047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.469006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c92f-1245-41ed-bba7-7484766b048d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.518675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.520002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.520735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.521177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.525452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd914-2f73-4dbb-8a10-25b5b48b307c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.536387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.538787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:37.558329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.559561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:37.560709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:37.560709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.560709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:37.566415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 394/788] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.566415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.573219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.574738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.575163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.575587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.576997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.577458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.579705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.597185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 395/789] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.598511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.671360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.687513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d12c-a017-44ae-9848-2ad6eb0fe068 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.727214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cb5c-d4ff-46e1-9689-5ba0cc6491c9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.728848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.737447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.738747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.739235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.739763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.741347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] RBAC: Adding query filter params (interface=public, service_id=0ebc5b6da5d6401f88106868d01eae93, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.741862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.743670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.753051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 395/790] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/endpoints?service_id=0ebc5b6da5d6401f88106868d01eae93&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.754395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.769232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.770236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.770467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.770838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.771577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.771974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.773524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.791720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 396/791] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.791720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.891253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f2ec1-d68c-49db-aa94-ce0a5622cd92 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.917146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15e7b-c5f6-4c69-8e06-68adf2886f8c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.926869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.927683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.927995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.928368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.929993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.937731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.939275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:37.952110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.953343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:37.954525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:37.956407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 396/792] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.958431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.965554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.966386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.967014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.967515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.968273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.969775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.977054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 397/793] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.978148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.024432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.073819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4adad-d42d-48c3-abd2-aa7d8b74ef3e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.122109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.126703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c11d7-5240-4ed0-8d27-98eb5511218b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.128837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.129467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.130752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.146177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.148383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-0f14ffa3-281c-4808-8071-a1abd1b35f3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:38.179183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.180198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:38.181156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 397/794] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.182382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243847-2865-4f9f-8256-f1f01175037d None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.182382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243847-2865-4f9f-8256-f1f01175037d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.182591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243847-2865-4f9f-8256-f1f01175037d None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.183972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 398/795] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:38.188204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.188597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243847-2865-4f9f-8256-f1f01175037d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.189448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.190016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.190532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.191664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.192274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.193872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a954b0-4a93-4751-b761-2d9c3b01a756 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.213681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 398/796] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:38.215416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.215871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.216356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.236706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:38.238159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:38.262541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.307216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243847-2865-4f9f-8256-f1f01175037d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.319693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 399/797] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:38.321256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.323532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.346683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.347309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.347642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.347968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.348715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.349068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.350646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.372674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 399/798] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:38.379623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.449194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799652ef-c79f-4575-9021-98d8cfa1f98a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.491196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.492084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.492992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.493454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.505605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.508005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:38.525792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.527008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:38.528127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:38.528127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.528127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:38.534791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 400/799] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.536956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.555403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.657212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d883-ea8f-4e56-a2e0-d36ed5040308 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.659347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c30db-a076-40d9-96a3-f911cb6debb6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.696193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.697178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.697657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.698113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.698970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.699456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.701287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.717769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 401/800] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:38.719431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.739892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.740594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.740889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.741164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.760554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.762018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:38.786014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.787064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:38.788984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:38.788984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.788984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:38.788984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 400/801] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.788984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.801501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.818628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.835122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a8884-4804-4beb-8b4a-4e67450ebcd3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.874214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.875070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.875462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.875847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.885073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.887173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:38.901407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.902354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.903285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:38.903717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e21f-9d93-49b1-8c6e-17e573f9c228 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.906876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 402/802] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:38.907473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.942354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.943016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.943313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.943581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.955320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c5cbc79c-471b-4499-bd77-5af91cdba3a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:38.961130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.962055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:38.963506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 401/803] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.964254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bcc9-5cee-435b-8821-1690267b7749 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.964254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bcc9-5cee-435b-8821-1690267b7749 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.964254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bcc9-5cee-435b-8821-1690267b7749 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.965678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 402/804] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:38.971174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28bcc9-5cee-435b-8821-1690267b7749 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.014986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34452e-4d7a-4ad3-88f5-dc799919b39f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.044041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.049943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.050599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.050886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.051167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.051806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.052110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.053459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.066111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 403/805] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.066955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.076703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.095885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28bcc9-5cee-435b-8821-1690267b7749 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.132802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.133394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.133679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.133951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.134671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.134979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.136414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960156a-823d-4af7-a6a6-06f1eb8a9a2b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.152786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 403/806] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.152786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.152786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.152786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.169603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:39.171831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:39.177931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20e41-e069-4182-88a0-dba7b047abb9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.213907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.214686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.214975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.215254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.215966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.216281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.218278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.232212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 404/807] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.232212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.291049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.339853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae181a-2a11-462a-977c-763721c5589d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.362481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 404/808] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:39.362481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.388296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.389628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.389909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.390231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.399269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.400861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:39.419385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:39.420675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:39.421948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 405/809] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:39.422471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.454084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.483553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cbd91-ba90-41ae-b14f-018ff74182de None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.519649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.520314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.520596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.520869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/6b75d4fa3ca04bd69c079295e3fc44e6/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.535679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=6b75d4fa3ca04bd69c079295e3fc44e6, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.537132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.550167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38be93-e907-495d-a9cf-9cd2e495d9f4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.571679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.585645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.586327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.586644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.586923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.598187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.602662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:39.614071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:39.617061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:39.617992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:39.617992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:39.617992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:39.617992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 406/810] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:39.617992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.641756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 405/811] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:39 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/6b75d4fa3ca04bd69c079295e3fc44e6/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:39.642904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.764422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca225f44-8c30-482f-b922-33bdc64aa71b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.785849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f25d9-dc70-4a32-b368-3343633b6638 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.818186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.819093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.819518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.819973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.820695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.821007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.821213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.822552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.836537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.836773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 407/812] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.836904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.837149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.837495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.837594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.838270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.842775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.842775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.855880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 406/813] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.856473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.877628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.963055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1d12-0523-43a8-ad43-0f049eb1da7b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.993959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8527484-27a0-4a0d-a4a4-60bde7e2c57b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.008912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.009961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.010353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.010759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.011445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.013920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:40.026459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:40.027707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:40.028765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:40.031659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 408/814] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:40.032637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.035481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.036350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.037041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.037462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/bb6314f7ac7e45b99d46d3e8a480150e/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.039609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=bb6314f7ac7e45b99d46d3e8a480150e, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.041195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.122482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 407/815] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:39 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/bb6314f7ac7e45b99d46d3e8a480150e/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:40.122482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.125533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.135830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50dbcd-4bfe-4fee-a678-5e853cb4e670 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.175227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.175892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.176168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.176445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.187177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.188694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.191492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-db519c98-23c8-45da-8898-9fe601bcd17f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:40.208837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:40.209915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:40.210980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:40.217734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 409/816] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:40.217734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e54-ab9a-4da9-90b4-550afeeb4170 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.217734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e54-ab9a-4da9-90b4-550afeeb4170 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.217734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e54-ab9a-4da9-90b4-550afeeb4170 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.223084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 410/817] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:40.226841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02713e54-ab9a-4da9-90b4-550afeeb4170 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.269397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609e85-356f-4608-89f0-4f9cba47e75d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.322072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.322659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.322943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.323215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.323866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:40.324166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.326475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73966ea8-0d0d-47fd-867b-13a9f9638604 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.331879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 408/818] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:40.333162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960119de-71af-4e02-931d-d2e03502454f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.333448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960119de-71af-4e02-931d-d2e03502454f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.333722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960119de-71af-4e02-931d-d2e03502454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.352799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-960119de-71af-4e02-931d-d2e03502454f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:40.354049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-960119de-71af-4e02-931d-d2e03502454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:40.362274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02713e54-ab9a-4da9-90b4-550afeeb4170 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.399413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.400299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.400751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.401173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.402059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:40.402541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.404135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.422543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 411/819] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:40.423573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.429582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 409/820] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:40.434647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.437409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960119de-71af-4e02-931d-d2e03502454f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.504020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.530331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe348-6ebc-4dab-a193-a2b2336dbabb None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.566826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.568121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.568557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.569040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.569851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:40.570307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.571833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.577876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 412/821] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:40.583550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.586508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960119de-71af-4e02-931d-d2e03502454f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.624973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.625712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.625997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.626272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.660285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.692124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a5e7-1ff8-4038-a65d-bebce31e86f0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.698777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.700357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.743017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.751733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.760892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.760892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.760892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.760892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.760892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.811295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 410/822] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:37:40.817585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.886793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 413/823] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:37:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:40.887919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.931171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664788-9d05-4bac-a6e9-d339799784bb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.975828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.976652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.977040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.977417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.985797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.004209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.007068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:41.030131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:41.031373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:41.032267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:41.032267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:41.032267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:41.033518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 411/824] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:41.041291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.111084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5e15-f1ad-446e-afec-c7bbd4399ba8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.139599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.148439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.149187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.149605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.149954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] PATH_INFO: `/v3/services/network` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.150817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.152328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:41.169649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:41.171253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:41.172373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 414/825] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:41.173176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97671-7061-4cd8-9402-7a416cd110c9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.173259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.204904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.205522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.205804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.206125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.206852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.207156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.208528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.223520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 412/826] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.229771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.280477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.289628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e88f-5578-477d-bd56-8c199980ec28 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.335360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.335981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.336262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.336536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.337526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] RBAC: Adding query filter params (name=network) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.337831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.340948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.356368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dbde8-0677-45d5-a470-a507ed39a373 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.360850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 415/827] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.388041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.425353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.426586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.428291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.429354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.440848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.442659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:41.455750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:41.456673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:41.457582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:41.460035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 413/828] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:41.469100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.477522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.562803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0ad1-93fa-475f-850f-2cdf9c6ec187 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.608322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.610326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.611851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.612571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.614766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] RBAC: Adding query filter params (type=network) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.615287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.619186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.629179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 416/829] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.641079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e9d0-e483-401f-b56c-ca0a77546177 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.649272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.653910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.709263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.711311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.713857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.714345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.715260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.715750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.718508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.743220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 414/830] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.754232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.803272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af668397-dde9-4d71-a6d1-b752a1664be9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.824704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.844595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.845223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.845504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.845777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.847247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.848618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178530f9-cc20-463b-8170-2115a1035b05 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.931940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a2a5-85e5-4761-bb26-0f18716e251a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.951599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 417/831] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:37:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:41.952875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b49c8-74fe-4e9b-b850-16bed86356cb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.953163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b49c8-74fe-4e9b-b850-16bed86356cb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.953437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b49c8-74fe-4e9b-b850-16bed86356cb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.955028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 418/832] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:41.961428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0034-063a-4e08-bac8-4750fe976de4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.961768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0034-063a-4e08-bac8-4750fe976de4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.961988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0034-063a-4e08-bac8-4750fe976de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.004856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-dbfc0034-063a-4e08-bac8-4750fe976de4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.006089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dbfc0034-063a-4e08-bac8-4750fe976de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.016507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.017198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.017549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.017824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.019813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:42.020133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.021615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc40d-a5b3-4bf6-be13-abd66a84e6bb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.041868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 415/833] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:42.109479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 419/834] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:42.281568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d52c9f-02a0-4398-a22c-2f559e00ae86 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.281857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d52c9f-02a0-4398-a22c-2f559e00ae86 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.282135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d52c9f-02a0-4398-a22c-2f559e00ae86 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.283872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 416/835] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:42.289532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.289970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.290151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.313324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.314568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.394634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 420/836] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:42.414796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d52c9f-02a0-4398-a22c-2f559e00ae86 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.444074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.523041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d52c9f-02a0-4398-a22c-2f559e00ae86 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.558435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.559025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.559307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.559582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.570833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:42.576167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.577125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.577977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:42.579334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 417/837] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:42.583961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.620228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.674133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.692930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149599fa-6c9b-4b8a-b5e4-eabb1ea2b095 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.737408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.738326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.738646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.738922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.739869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:42.740181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.741704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.753063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 421/838] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:42.758213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.770596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.793563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe917c5c-c5a7-40f2-b843-0c9e97827600 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.843438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.844081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.844393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.844644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.857143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:42.863557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.864498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:42.865352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:42.869661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 418/839] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:42.870975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.887201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.891678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b25cdf-3e9f-4e33-bc2c-5d025b15c79a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.937595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.938271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.938588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.938868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.954295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.956141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:42.978418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.979442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:42.980358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:42.980358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:42.980358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:42.982516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 422/840] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:42.987302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.998513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98ec58-7ebf-43c7-855a-7026e39875ce None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.033364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.033978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.034256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.034568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.035238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.035593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.037001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.053675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 419/841] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:43.055804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.071352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.117845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb69a-dae6-48c3-8fa4-418fdf56f690 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.158358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.159284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.160090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.160522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.161631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.162240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.164045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.184902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 423/842] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.186906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.189626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c26f-4e8b-4e07-bd6e-1ea290e766b1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.201141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.225982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.226814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.227173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.227520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.239001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.240584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:43.255513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.256504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:43.257413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:43.257413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.257413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:43.261920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 420/843] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:43.263903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.305446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984333-71da-4026-b384-8f804661f2bc None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.327989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.345000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.345628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.346378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.346378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.353335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.354782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c2db3d61-421e-430a-a588-d47be8290c0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:43.367563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.368555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:43.369524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 424/844] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:43.371028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534ea1-834a-4d1e-b0c8-913712065bde None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.371028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534ea1-834a-4d1e-b0c8-913712065bde None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.371028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534ea1-834a-4d1e-b0c8-913712065bde None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.371740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 425/845] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:43.374681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534ea1-834a-4d1e-b0c8-913712065bde None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.382177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d99c-1bb7-4575-bc25-430464033aef None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.417317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.417922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.418201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.418769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.419180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.420053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.421657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ce6-d900-4bd2-822c-15dbaf2a9d29 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.438607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 421/846] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:43.438607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.438607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.438607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.454434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:43.454610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.455643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:43.486997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534ea1-834a-4d1e-b0c8-913712065bde None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.523852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.530539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 422/847] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:43.530713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.530713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.530713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.530959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.531041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.531041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.531041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.556106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 426/848] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:43.561130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.587004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.643968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fecd3f-fc02-43ab-b207-756ebb8c82af None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.665079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6301-76d5-4dc6-84b3-81a5d0118c72 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.684902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.686038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.686633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.687083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.693119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.696275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.698023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.701324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.701994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.709300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.709300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:43.711924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.712843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:43.713822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:43.717024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 423/849] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.722301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.779491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.780937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.844936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125cd44-cd62-487a-963a-0af5430d9055 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.855148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.877680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.878288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.878613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.878887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.879619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.879921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.881379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.893866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 427/850] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:37:43.893866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.908563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 424/851] 10.222.0.47 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.908563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.928910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.004442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e99ff-5cd2-46a0-8105-6859068a7678 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.010839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0d451-6db2-4c13-8999-69cc663c7fb5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.038946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.039576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.039857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.040129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.040707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.042054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.050900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.051910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:44.052759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 428/852] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.054125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.054976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.055623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.055911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.056189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.067058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.068652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:44.085206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.086182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:44.087124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:44.087124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.087124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:44.087124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 425/853] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.087124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.110717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.155806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.164394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14150-14ab-4d57-8f40-24c469955b6e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.189683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3feff-35e5-4b78-8635-3ff8a86245e6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.197911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.198588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.198872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.199145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.223101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.223709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.223993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.224293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.224931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.225237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.226636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.230935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 426/854] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.231734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.266789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.268244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da41a5-3923-4431-850e-33fef72fab87 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.315825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.331288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f21c2-3dec-4d23-bd33-ee993479c8c0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.356675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.364610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.370553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.370553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.370757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 429/855] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:44.370864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.370864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.370864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.371086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff799-0321-4514-8aef-153370f0b2f7 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.371086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff799-0321-4514-8aef-153370f0b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.371086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff799-0321-4514-8aef-153370f0b2f7 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.371314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.371395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 430/856] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:44.371395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff799-0321-4514-8aef-153370f0b2f7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.383618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 427/857] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.384440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.470089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff799-0321-4514-8aef-153370f0b2f7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.482298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc148-5865-41f8-b09f-98ce1c4ed686 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.503760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.504361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.504641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.504922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.505549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.505851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.507244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d35f03-8b6e-4485-a492-81bdc173d65e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.511482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 431/858] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.512597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.512882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.513200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.515351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.515992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.516274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.516542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.529307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.531737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.535529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.537005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:44.538270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:44.551207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.552378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:44.558378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:44.558378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.558378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:44.558378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 428/859] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.558378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.598867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.616816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 432/860] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:44.617526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.687203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2f89-1520-4301-af42-63ff647bc57d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.730059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.730657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.730945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.731224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.741232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.743263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.746975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb729bf4-78eb-4bb9-b612-f3835d05dc1f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:44.758573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.759540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.760529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:44.762562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 429/861] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.766312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.791119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.791736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.792023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.792301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.792953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.793257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.795273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.807712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 433/862] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.814202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.853706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.870104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.914791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964620-9ec6-4010-be4b-5bac1ab519fc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.931559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e21df3-e866-484f-8314-6e0cc6b1351d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.957706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.959277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.959803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.960448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.961952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.962498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.964165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.965540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.966950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.967242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.967513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.974191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.975644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.979897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 430/863] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.981005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:44.991650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.992597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 434/864] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.993489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.089831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7144d6-c5eb-4ef6-a8d2-efe2dc7478ec None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.101519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad106b-957b-447d-9a7e-2108659fbdf3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.109882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.113004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.128291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.128933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.135193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.135193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.135193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.135193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.136221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.136829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.137111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.137384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.138156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=6b75d4fa3ca04bd69c079295e3fc44e6) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.138476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.140042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.140696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.141623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:45.142941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 431/865] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.143751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.162695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 435/866] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/role_assignments?user.id=6b75d4fa3ca04bd69c079295e3fc44e6&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.162695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.280919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3832ce-3d6a-452b-b02c-b02377fa3060 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.281189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06363cea-620f-4986-8eea-8ce3f2854164 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.319609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.320216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.320498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.320773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.321528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.321650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.321840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.322143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.322430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.322735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.323287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.323387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.323664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.325139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.332101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 436/867] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.337013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 432/868] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.343691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.344439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.386301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.390912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.468345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c24bd-0ea0-46b0-9c35-2313766e8f5b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.469017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1f1e-3bf2-4690-83f1-93ddd0917271 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.514595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.515216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.515501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.515604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.515779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.516212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.516504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.516610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=bb6314f7ac7e45b99d46d3e8a480150e) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.516780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.516877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.517423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.517730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.518213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbdb90-6e7b-4bbc-b018-50a0256f0434 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.519114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8640-9a91-464c-8d4f-3d64d23faff6 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.524640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 437/870] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.524796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 433/870] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/role_assignments?user.id=bb6314f7ac7e45b99d46d3e8a480150e&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:46.505573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391dc4-1d20-404e-bdce-43fc7191292a None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.506136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391dc4-1d20-404e-bdce-43fc7191292a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.506429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391dc4-1d20-404e-bdce-43fc7191292a None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.508142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 438/871] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:46.513472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0795-0c75-44c5-bd96-5c4f028ccca5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.513912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0795-0c75-44c5-bd96-5c4f028ccca5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.514016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0795-0c75-44c5-bd96-5c4f028ccca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.533275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e5fd0795-0c75-44c5-bd96-5c4f028ccca5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:46.534490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e5fd0795-0c75-44c5-bd96-5c4f028ccca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:46.604371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 434/872] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:46.877523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391dc4-1d20-404e-bdce-43fc7191292a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.979819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.984689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391dc4-1d20-404e-bdce-43fc7191292a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.020205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.021471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.021755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.022029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.022724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:47.024096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096b2e-fe24-4c39-b7db-ab1e749f6abb None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:47.098631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 439/873] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:37:46 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:47.295759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c3a5-eed8-42e4-8d01-d0dc1626d96e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.296377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c3a5-eed8-42e4-8d01-d0dc1626d96e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.296579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c3a5-eed8-42e4-8d01-d0dc1626d96e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.298191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 435/874] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:47.303281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133e9c-0919-4988-be9e-2d8a78bc5fac None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.303577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133e9c-0919-4988-be9e-2d8a78bc5fac None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.303853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133e9c-0919-4988-be9e-2d8a78bc5fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.324054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-71133e9c-0919-4988-be9e-2d8a78bc5fac None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:47.325937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-71133e9c-0919-4988-be9e-2d8a78bc5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:47.410412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 440/875] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:47.506288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9b8c-6e94-4a95-8bcd-d019f229878e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.506655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9b8c-6e94-4a95-8bcd-d019f229878e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.506886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9b8c-6e94-4a95-8bcd-d019f229878e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.508463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 436/876] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:47.514373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.514846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.514941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.531765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a8bfa-de68-41b7-bd82-aadc8073ce5b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.532735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a8bfa-de68-41b7-bd82-aadc8073ce5b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.533208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a8bfa-de68-41b7-bd82-aadc8073ce5b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.534023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:47.535228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 437/877] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:47.535335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:47.540774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.541303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.541773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.565434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:47.567911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:47.602886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:47.618627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 441/878] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:47.651446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 438/879] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:47.699037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.715583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:47.806088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01373c10-683a-4d25-9b58-ee67a326f631 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.841359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.841990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.842267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.842572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.852761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:47.858308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:47.859268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:47.860117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 442/880] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:47.865695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.905412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.977314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f6350-cd0a-4077-921b-3a9035ec21e2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.004446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.013385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.018024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.025312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 439/881] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:48.026317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.031209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952411-d1a5-4cd7-b1a3-dbdb7ade303c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.061733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.070196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.070347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.070608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.070853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.071511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.072863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.136225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27c392-9426-4088-b683-cf7ee13ba705 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.158504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 443/882] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:37:47 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:48.158504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.180782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.181526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.181877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.182221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.182936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.184765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.195634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:48.196759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:48.197665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:48.202321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 440/883] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:48.203315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.298910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802fea-35c5-4024-80a0-19de4a80c7c8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.326286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.342861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.343476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.343754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.344023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.346091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529babc-e14a-4a12-9eab-4b95ee422b65 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.346294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.358733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.360390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:48.375513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:48.376685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:48.377614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:48.377614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:48.377614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:48.377614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 444/884] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:48.382187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.399473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.400085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.403435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.403435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.403435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.403435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.403435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.409095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 441/885] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:48.414684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.492730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9175-01a1-48d9-bc4b-57ef98b87e98 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.528188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.528906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.529470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.530060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.530781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.531089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.531996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b104de4-dae9-4509-bc14-9badc8ff1425 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.532446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.550638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 445/886] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:48.555377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.584352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.585112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.585717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.586066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.586962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.587700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.589748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.598850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 442/887] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:48.617481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.680570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb9f77-0103-49b9-99a6-89609cd200d9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.721635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.722294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.722607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.722937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.732071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.733574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:48.746645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:48.747951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:48.748909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:48.752626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 446/888] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:48.753612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.772039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.869610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7887e7-b7ab-4c8b-b7da-b95271849530 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.904201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.904802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.905081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.905347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.906142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.906468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.907880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f0e7-3d2c-4b1e-9f64-00189849f336 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.927007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 443/889] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:48.932649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.042582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d381-904f-44da-9e50-29bf05d86f83 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.050402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.078238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.079248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.079764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.080255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.108255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11c3a-0918-404b-a396-1139cc946ad1 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.108572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11c3a-0918-404b-a396-1139cc946ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.108744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11c3a-0918-404b-a396-1139cc946ad1 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.110029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 444/890] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:49.116326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.116612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.116888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.136780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:49.138540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.157269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.159167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.232032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 445/891] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:49.271645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 447/892] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:49.280431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.283327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.389909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cac0-dc48-4bcc-ba4a-bcd39969a6c3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.427945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.428585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.428871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.429148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.439408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.440917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:49.456147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.457086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:49.458125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:49.458125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:49.458125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:49.458125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 446/893] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.462918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.488568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.507635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.571939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e41da-68c0-4f5e-9e4a-b65316864851 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.573577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.610812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.611834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.612297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.612806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.613648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.614127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.615815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.627729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60497-87fd-45ed-adee-1aa55547489a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.628719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 448/894] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.638476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.666936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.667508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.667798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.668081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.668678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.670724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.679967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.681023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:49.682099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 447/895] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:49.691674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.712167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.751397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57c2e1-ccd6-4f03-90fc-e436f799eb7c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.789499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.790484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.790948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.791399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.801330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.803203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:49.815647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.816570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:49.817467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:49.820090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 449/896] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.826090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.839873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef65b3-a639-4321-8133-7408d679b329 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.862084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.880483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.900762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.901194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 448/897] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.901194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.968096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de201-d4ce-426b-93dc-ac8ed9207671 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.996470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.006398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.007040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.012626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.012626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.012626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.012626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.012626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.018978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ffd6f-0457-49b6-9174-f601bf8a0c21 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.028699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 450/898] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:50.029815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.071628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.072594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.073125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.073611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.075074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.075663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.077713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.085432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 449/899] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:50.093993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.147477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.155553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb239-f52a-4dc9-85c0-9209f355c39e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.206394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1f78-f8ca-4ef4-9fb7-bee49d5fce84 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.208479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.209097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.209373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.209640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.210367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] RBAC: Adding query filter params (role.id=0550ae856cff42c88708b154ea85e1b2, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=6b75d4fa3ca04bd69c079295e3fc44e6) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.210697 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.212108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f4ad1-f868-498c-9bb4-5f3b6a783292 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.219907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 451/900] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/role_assignments?user.id=6b75d4fa3ca04bd69c079295e3fc44e6&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=0550ae856cff42c88708b154ea85e1b2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.254578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.255600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.256169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.256645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.257629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] RBAC: Adding query filter params (interface=public, service_id=b1dc39f77aaf41609e63084869ce8b67, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.258215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.259846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.266476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59ff1-6598-42f4-b287-9560f49211ab None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.266822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59ff1-6598-42f4-b287-9560f49211ab None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.267060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59ff1-6598-42f4-b287-9560f49211ab None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.268363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 450/901] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/endpoints?service_id=b1dc39f77aaf41609e63084869ce8b67&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.268636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 452/902] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:50.273458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.273687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743f80-7664-486a-a8ca-03c04385043d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.273982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743f80-7664-486a-a8ca-03c04385043d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.274244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743f80-7664-486a-a8ca-03c04385043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.295498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-44743f80-7664-486a-a8ca-03c04385043d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:50.297064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-44743f80-7664-486a-a8ca-03c04385043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:50.351922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.382582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 453/903] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:50.401060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbfff-13b9-4e44-9b5e-1ad9e5edd5f1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.413015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.438312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.439318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.439799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.440274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.441096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.442715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac287cc-c880-4864-9072-d7be9118dab7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.449047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 451/904] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:37:50.656102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743f80-7664-486a-a8ca-03c04385043d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.732444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf29f5-367e-435e-a947-a27ad3dbd2b9 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.732953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf29f5-367e-435e-a947-a27ad3dbd2b9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.733059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf29f5-367e-435e-a947-a27ad3dbd2b9 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.734580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 452/905] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:50.739670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.739953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.740225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.759243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:50.760531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:50.761661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743f80-7664-486a-a8ca-03c04385043d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.805409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.806064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.806351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.806663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.807262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.808621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:50.826810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:50.827858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:50.828759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 454/906] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:50.837319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.850936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 453/907] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:50.890187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.948290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fda6-8070-4000-9ca1-101bf45bd0fd None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.984146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.985022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.985470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.985880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.986667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.987107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.988607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.993808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 455/908] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:51.000427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.110826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2a1d-73a8-487a-91a1-72d8a5c26608 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.113416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.122771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.152246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.152911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.153810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.154095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.155041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.155352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.157213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.163939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 454/909] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:51.169140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.263317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc296-7d9d-4d06-b340-2d31e21ce28e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.276078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.284135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288440-ac7c-42a0-ba82-b35073185271 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.312280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.313532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.314258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.315150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.316295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.318509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851d10-ed22-48ff-bd8b-e2fffb655331 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.322830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.323557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.323908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.324486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.325622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] RBAC: Adding query filter params (interface=public, service_id=2f714cece4e74c8d84a417518ec5b3d1, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.326232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.327621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.337642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 455/910] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/endpoints?service_id=2f714cece4e74c8d84a417518ec5b3d1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:51.338786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.371893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.406522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 456/911] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:37:51 2022] POST /identity/v3/services => generated 241 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:51.453854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54697-4b02-4570-893a-32dd7b6034d4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.508746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.509367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.509644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.509911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.510553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.511934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c119c-bf79-42f9-a87c-fdf4be67bfd4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.519225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 456/912] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:37:52.265766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd5d2-f111-441a-b315-1f5266edc8d8 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.266288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd5d2-f111-441a-b315-1f5266edc8d8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.266288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd5d2-f111-441a-b315-1f5266edc8d8 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.267951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 457/913] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:52.273137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba097-c440-4064-9410-02e6bcc5d0a0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.273525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba097-c440-4064-9410-02e6bcc5d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.273693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba097-c440-4064-9410-02e6bcc5d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.292135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-55bba097-c440-4064-9410-02e6bcc5d0a0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:52.293319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-55bba097-c440-4064-9410-02e6bcc5d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:52.366578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 457/914] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:52.431738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3d74-0e65-4633-ac42-c392ec1da8bb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.432063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3d74-0e65-4633-ac42-c392ec1da8bb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.432295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3d74-0e65-4633-ac42-c392ec1da8bb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.433896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 458/915] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:52.438941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.439227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.439497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.457945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:52.459157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:52.476870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.527544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 458/916] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:52.641721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d3d74-0e65-4633-ac42-c392ec1da8bb None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.750292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d3d74-0e65-4633-ac42-c392ec1da8bb None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.784554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.785498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.786001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.786508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.797167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.799339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:52.804590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:52.805524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:52.806390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:52.809232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 459/917] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:52.818399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.850998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.930066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2041-0cbc-402f-ac5b-a0db6b5b12f8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.939162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc592a-000d-477b-96f2-4e3ec6fadd01 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.973291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.973917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.974201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.974500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.975180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.975484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.976967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.990237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.991044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 460/918] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:52.991815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.991926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.992519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.993044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.993849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.997311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.009129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.010193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:37:53.011083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:53.014533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 459/919] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.026573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.052302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.097467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.108015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8e49d-2090-4b24-a65a-026883ca5964 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.147504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.148259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.148545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.148817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.154025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bd89-1fc5-48c9-b6c8-c032a469c1bb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.160169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.161746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:53.178188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.179384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:53.180425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:53.180425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.180425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:53.180425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 461/920] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.187067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.194578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.195252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.195532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.195803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.196439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.196797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.198208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.208713 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 460/921] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.209586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.302825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b46c-22f6-44fd-9cf5-703679b5531b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.321014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.341527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.342336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.342743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.343109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.343852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.344252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.345754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.348053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6b75-0035-4325-a4bd-07eaf61c52b4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.363222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 462/922] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.364302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.368768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.392506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.393116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.393403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.393675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.394309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.394652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.396014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8795a-0232-4e6b-9914-4824ffde4f4a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.401653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 461/923] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.403536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd7c-b884-4b87-a663-c1ad4501affe None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.403998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd7c-b884-4b87-a663-c1ad4501affe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.404272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd7c-b884-4b87-a663-c1ad4501affe None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.405755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 462/924] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:53.414690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febd7c-b884-4b87-a663-c1ad4501affe None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.482005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf403-7e53-4d24-aa49-8ce2b07ab83d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.512810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febd7c-b884-4b87-a663-c1ad4501affe None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.518140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.519044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.519542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.520393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.529748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.531433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-32e0ca59-016b-4331-ac1a-b699e817b7be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:53.543261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.544346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:53.545297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:53.551968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 463/925] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.551968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.551968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.551968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.554020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.554569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.554853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.555124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.555822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.557186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d795-89c9-4222-858e-f22c78a168f7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.567602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:53.568795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:53.624551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.633875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.634542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 464/926] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:53.635352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.650473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 463/927] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:37:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:53.650473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2756-9b39-4ae1-830a-1e474919fd39 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.650473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2756-9b39-4ae1-830a-1e474919fd39 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.650473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2756-9b39-4ae1-830a-1e474919fd39 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.650473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 464/928] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:53.653935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.654460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.654906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.676770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:53.678241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:53.767555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 465/929] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:53.786539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12022b-e056-461f-90f4-a0a85baeeadb None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.833895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.834731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.835174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.835454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.836192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.836494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.837903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.857709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 465/930] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.863277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.906770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.971478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.989095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50a33b-2797-4c41-9261-6812b6b0e917 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.023701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fd9c-5931-4a38-adcd-0f073eb3a538 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.033813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.034645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.035027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.035394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.046165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.047128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.048689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:54.065023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.066035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:54.067599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:54.067599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:54.067599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:54.067787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.067787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.067787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.067986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 466/931] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.068067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.068067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.068233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.068605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.081282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.082635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:54.083662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:54.086884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 466/932] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:54.087949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.180997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5389f-0329-49cd-a62b-88e74d4e692f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.189869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef023fc-a04c-422e-a555-91af885ed10f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.205039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.217938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.218620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.218902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.224655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.224655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.224655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.228446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.229123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.229473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.229809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.230483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.232293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:37:54.233431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:54.235304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.235304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.235578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 467/933] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.235578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.235846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.249849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 467/934] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.250747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.287624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.346965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af219-315d-4aa1-bb4f-9d1833c93a66 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.360885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddbd6-719b-45b9-a0dc-34fde159eaa7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.381962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.382611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.382903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.383179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.383825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.384133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.385506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.391435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 468/935] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.392071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.405925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.406635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.406854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.407127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.407759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.408124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.409470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.414649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 468/936] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.415420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.461154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.499566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfd68f-afa5-4d5c-907e-e1f50438de09 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.508052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.524790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c355e-4474-4799-9d16-4a597c0e916c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.538104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.538770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.539057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.539332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.547022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.549152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.559709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.560318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.560604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.560880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:54.561200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.562247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:54.563383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:54.568695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.568695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.568695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.568932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 469/937] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.568932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.573404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 469/938] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.578955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.682807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59218-567a-4062-a71e-4464d654bed9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.683532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48c06-969d-4706-a6a5-a32c354ace19 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.685558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.718897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.719753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.720111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.720492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.721244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.721611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.721848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.722566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.722914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.723255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.723370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.724009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.724401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.726261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.733423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 470/939] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.733423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.744154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 470/940] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.745062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.768747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.846784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39192-3dea-46a3-9027-4043ea3ae8ec None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.862893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c6c8-c2f8-44dc-ae25-3c758246db5d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.883917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.884859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.884859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.885092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.885741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] RBAC: Adding query filter params (interface=public, service_id=ea41e1181d514b4599986b15d00ac8b0, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.886046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.888217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.893357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 471/941] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/endpoints?service_id=ea41e1181d514b4599986b15d00ac8b0&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.893946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.905264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.905957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.906318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.906702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.907387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.908752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.990430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.996845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9890-cd54-4c45-933a-2cdb7587139f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.016291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 471/942] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:37:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:55.017133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.042316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.043032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.043317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.043603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/6b75d4fa3ca04bd69c079295e3fc44e6/roles/0550ae856cff42c88708b154ea85e1b2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.046667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=6b75d4fa3ca04bd69c079295e3fc44e6, role_id=0550ae856cff42c88708b154ea85e1b2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.048140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f07-a43a-4c8e-b510-2e97474f4510 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.057968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.156919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8271-5d54-4d17-9205-e9da59891874 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.191574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.192180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.192458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.192731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.193335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.194718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d796-b0e5-4836-94bd-9ee87a8695bd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.202997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 472/943] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:54 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/6b75d4fa3ca04bd69c079295e3fc44e6/roles/0550ae856cff42c88708b154ea85e1b2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:55.206430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 472/944] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:37:55.700712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df776c-435e-4382-b5dc-2c1e4a5b7679 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.701589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df776c-435e-4382-b5dc-2c1e4a5b7679 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.702091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df776c-435e-4382-b5dc-2c1e4a5b7679 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.703944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 473/945] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:55.709598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.710466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.710962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.731408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:55.733257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:55.807381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 473/946] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:56.089247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df776c-435e-4382-b5dc-2c1e4a5b7679 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.204256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df776c-435e-4382-b5dc-2c1e4a5b7679 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.239874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.240486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.240763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.241037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.241698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.243160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.245744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING keystone.server.flask.common [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 14:37:56.343778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.sql.core [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:37:56.343778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:37:56.343778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [parameters: {'id': 'df17eede6c3749a78f74e1fcd801ada9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:37:56.343778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df17eede6c3749a78f74e1fcd801ada9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df17eede6c3749a78f74e1fcd801ada9. Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:56.351183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 14:37:56.353749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application yield resource Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise self.value Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application session.commit() Aug 30 14:37:56.354764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:37:56.355764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:37:56.356697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:56.357520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [parameters: {'id': 'df17eede6c3749a78f74e1fcd801ada9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.358408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:56.361222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df17eede6c3749a78f74e1fcd801ada9. Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:56.363318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 474/947] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Aug 30 14:37:56 2022] POST /identity/v3/projects => generated 262 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:56.364814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.383625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.473040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758880-0bf7-4b00-ba5b-0ab91541f89b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.508122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.508765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.509048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.509324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.516908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.518332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-618aac35-14ca-4a3f-9b96-8497dc015ecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:56.530366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:56.531271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:56.532229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 474/948] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:56.537896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.548740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.650487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bdb7-ed68-48e4-889e-d57105cad913 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.688472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.689460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.689992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.690517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.691426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:56.691939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.693807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4693c7-d516-4da0-b47c-818fdebce694 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.716659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 475/949] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:57.003092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e65b6-6c61-4c34-8c13-5a719af8e090 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.003627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e65b6-6c61-4c34-8c13-5a719af8e090 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.003627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e65b6-6c61-4c34-8c13-5a719af8e090 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.005083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 475/950] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.010411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8c0f-bfb2-47da-8f7c-75df17f640fb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.010732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8c0f-bfb2-47da-8f7c-75df17f640fb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.011006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8c0f-bfb2-47da-8f7c-75df17f640fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.030518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4b5c8c0f-bfb2-47da-8f7c-75df17f640fb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.032030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4b5c8c0f-bfb2-47da-8f7c-75df17f640fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.107992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.117242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 476/951] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:57.169022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a551a-5b93-4ac8-8ecb-728376bded4b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.169278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a551a-5b93-4ac8-8ecb-728376bded4b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.169552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a551a-5b93-4ac8-8ecb-728376bded4b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.172417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 476/952] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.176798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f051-f12f-45e8-9d1f-7f4b1eed3d67 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.177133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f051-f12f-45e8-9d1f-7f4b1eed3d67 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.177371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f051-f12f-45e8-9d1f-7f4b1eed3d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.195817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5051f051-f12f-45e8-9d1f-7f4b1eed3d67 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.197008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5051f051-f12f-45e8-9d1f-7f4b1eed3d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.271521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 477/953] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:57.294889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044d25-2e94-419e-90f4-b72de7c9745c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.295768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044d25-2e94-419e-90f4-b72de7c9745c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.296260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044d25-2e94-419e-90f4-b72de7c9745c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.297787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 477/954] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.303300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.303835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.304329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.325275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.326842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.386333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044d25-2e94-419e-90f4-b72de7c9745c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.398736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 478/955] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:37:57.460511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.496078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044d25-2e94-419e-90f4-b72de7c9745c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.532032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.532600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.532881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.533152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.533730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.535109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.543727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.544400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.545759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:57.547060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 478/956] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.553007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.609279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.662137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38fab-4401-477b-8d83-f56ae1034baf None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.673570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11f87-f30d-414e-9709-610b72cb9c0f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.702044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.703554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.703995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.704576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.705638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.707699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.712867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.713473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.713757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.714031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.714694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:57.715544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.717009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.718783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.719572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.720908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:37:57.721929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:57.722747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 479/957] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.723471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.733486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 479/958] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:57.733944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.835071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac722-86f0-4fcb-a91d-a7a44c3ecdf1 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.857535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.858988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7278-2e46-475e-b6d7-6ae2476f9a12 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.872786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.873419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.873771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.874057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.884716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:57.890176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.891215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 480/959] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.892173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.899810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.900728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.901195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.901683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.903241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:57.904048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.905935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.912010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 480/960] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:57.913311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.980129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.008813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2941b3a-c4c9-459c-bfbc-70dca0e3d604 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.019172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49eb2c-8669-46c4-8acd-5012d9a084c1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.046894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.047584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.047871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.048151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.048782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.049090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.050473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.055028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 481/961] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.055332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.055799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.056382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.056671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.056945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.057621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.057928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.059408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.076134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 481/962] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.077461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.117970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.181227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ad5b-a32d-46db-869b-ebecf0e97a3a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.217983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e1d0-0f23-47b5-9d68-0e411b5f7d5e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.219530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.220162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.220448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.220721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.221375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.221683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.223114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.239840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 482/963] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.241102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.252265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.266470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.281716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.281716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.281716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.281716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.281716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:58.302492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:58.303519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:58.304448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:58.304448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:58.304448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:58.309062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 482/964] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:58.309062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.365557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fffd17-d41c-44d8-bee9-0f9b2236fab3 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.376546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.404551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.405880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.406411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.407015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.407989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.409715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.428631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f00bf-3793-4e1c-91df-23dd13f65d9c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.465405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.466183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.466590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.466913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.467560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.467896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.469272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.487091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 483/965] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:58.492065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.497274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 483/966] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:37:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:58.542138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.618078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e80047-904b-41d6-ab42-79c3c161d65c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.667784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.668954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.669235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.669515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.677357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.679111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-02f2beb5-6f01-4ea8-8086-bad693ecba6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:58.690794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:58.691785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:58.692768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 484/967] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:58.697607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.748414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5687d-db49-4957-a95a-f8c733c3bc33 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.748695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5687d-db49-4957-a95a-f8c733c3bc33 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.748972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5687d-db49-4957-a95a-f8c733c3bc33 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.754006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 485/968] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:58.755180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.755464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.755741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.774856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:58.780048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:58.815165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262a9d8-64f4-4205-8ebd-72aff8a96936 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.862680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.863606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.863898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 486/969] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:37:58.864385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.865005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.865955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.866480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.868122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.892372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 484/970] 10.222.0.47 () {56 vars in 1149 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.897612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.924469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.005666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cbe74-54cb-469e-88ca-59fac531eaae None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.045058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.045964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.046232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.046578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.118565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.120048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.146350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.163671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.201829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.240629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 487/971] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:59.241723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.305107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d6ed-fe0b-4494-a9b3-c7fd436d8e3c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.354575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.357998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.357998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.357998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.357998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.359426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.383614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552156-4487-4940-88e8-936931f83b65 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.406145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.sql.core [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:37:59.406145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:37:59.406145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [parameters: {'user_id': '4e1cef49f9154b92936bfe386f2fe9c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:37:59.406145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:59.412853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:59.413812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application yield resource Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise self.value Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application session.commit() Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:37:59.414834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:37:59.415754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:59.416727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:59.417589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [parameters: {'user_id': '4e1cef49f9154b92936bfe386f2fe9c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:59.421162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 14:37:59.423213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 485/972] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 30 14:37:59 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:59.426735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.430968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.445723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.447059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.447440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.447822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.463548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.465561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:59.484704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:59.486372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:59.487556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:59.487556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:59.487556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:59.493257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 488/973] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:59.494350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.536885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.558408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6409f1-f0c9-421c-ad01-f9d42bc37149 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.605878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.606771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.607458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.608051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.618514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.620986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.628957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574d3c3-524e-4eaf-aa79-4a9490d3a75c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:59.636555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:59.638329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:59.639603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:37:59.646484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 486/974] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:59.648002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.681268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.682407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.682818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.683191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.684733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:59.685268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.686768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.707479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 489/975] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:59.708930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.757172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.784055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4fb1-8dbc-446d-8c72-400571e86ac9 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.832725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.834063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.834618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.835173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.836131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:59.837149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.839080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.848084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140fa86-ae93-4008-a3d0-3e9bdd5f608a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.890709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.890709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.890709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.890709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.891388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 487/976] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:59.897867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:59.899375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:59.912750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:59.913743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:37:59.914701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 490/977] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:59.921142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.925859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.034729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01063-3fe1-4e31-a094-ee0b436da46e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.071811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.072432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.072711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.072984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.073678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:00.073986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.075622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8896bf-fab4-45b9-91d0-b5120c3fecc5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.088210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 488/978] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:00.094882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.172626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9123-0025-4dcc-aded-7eb95e90afcc None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.172960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9123-0025-4dcc-aded-7eb95e90afcc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.173235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9123-0025-4dcc-aded-7eb95e90afcc None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.174858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 489/979] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:00.179694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ab71-a6d7-4992-9e0e-cd91e3c46603 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.179974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ab71-a6d7-4992-9e0e-cd91e3c46603 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.180248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ab71-a6d7-4992-9e0e-cd91e3c46603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.203127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-25d3ab71-a6d7-4992-9e0e-cd91e3c46603 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:00.204656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-25d3ab71-a6d7-4992-9e0e-cd91e3c46603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:00.209498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.215229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d205d-fa05-45fb-904c-d7cf0b27de39 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.259740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.260346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.260627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.260896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.261673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] RBAC: Adding query filter params (role.id=0550ae856cff42c88708b154ea85e1b2, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=6b75d4fa3ca04bd69c079295e3fc44e6) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:00.261982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.263462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.269496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 491/980] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/role_assignments?user.id=6b75d4fa3ca04bd69c079295e3fc44e6&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=0550ae856cff42c88708b154ea85e1b2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:00.283851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.302276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 490/981] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:00.564042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.631995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d4a9-98e0-435d-a8a3-a01bf7787229 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.632346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d4a9-98e0-435d-a8a3-a01bf7787229 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.632562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d4a9-98e0-435d-a8a3-a01bf7787229 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.634043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 491/982] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:00.639738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.640030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.640311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.658249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:00.659513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:00.667150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3633-7e2e-486d-aa90-8f7d6fcace1d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.703620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.704228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.704505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.704782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.705439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.706805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.729468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 492/983] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:00.780949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 492/984] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:00 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:01.000247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.098673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03ee4-638d-48ff-9884-9e14ccfe41ca None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.122124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.141227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.141867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.142206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.142503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.143094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.144445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:01.154201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:01.155375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:01.156245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:01.158529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 493/985] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:01.161548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.184482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.265619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1200f-614f-4b7d-b2b0-05118013b6ad None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.301711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.302325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.302638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.302925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.303551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.303856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.305215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.315278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 493/986] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:01.316828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.422382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7053c9-b67e-43dc-9ab3-5ac5bd69d24f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.456576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.457192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.457475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.457752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.458384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.458719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.460081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.465145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 494/987] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:01.470992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.554004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.569561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0e0de-35da-43dc-b5d3-8cd4bf0e676d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.603476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.604076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.604400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.604676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.605516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] RBAC: Adding query filter params (interface=admin, service_id=ea41e1181d514b4599986b15d00ac8b0, region_id=RegionOne) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.605516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.607128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c17a2-d209-41c5-9811-59e1754f1646 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.618902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 494/988] 10.222.0.47 () {56 vars in 1249 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/endpoints?service_id=ea41e1181d514b4599986b15d00ac8b0&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:01.620514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.674227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.728593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f8ac-8975-45b7-bdda-9289a022101b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.764682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.765301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.765584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.765860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.766484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.767854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f14fac-d60c-4e53-bd97-66289a1cda17 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.777314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 495/989] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:38:02.233098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c395-7f77-4d56-979a-9bba8b53ae89 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.233618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c395-7f77-4d56-979a-9bba8b53ae89 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.233618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c395-7f77-4d56-979a-9bba8b53ae89 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.235008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 495/990] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:02.240330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bf26-0707-4995-8601-6b9486832cc8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.240732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bf26-0707-4995-8601-6b9486832cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.240930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bf26-0707-4995-8601-6b9486832cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.259045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a9b5bf26-0707-4995-8601-6b9486832cc8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:02.260241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a9b5bf26-0707-4995-8601-6b9486832cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:02.330064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 496/991] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:02.604397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c395-7f77-4d56-979a-9bba8b53ae89 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.702308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125f7b-8811-4b00-8473-64406a6db805 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.702669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125f7b-8811-4b00-8473-64406a6db805 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.702873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125f7b-8811-4b00-8473-64406a6db805 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.704212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 497/992] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:02.709028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.709315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.709595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.713001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c395-7f77-4d56-979a-9bba8b53ae89 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.727070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:02.728244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:02.752303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.752950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.753232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.753528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] PATH_INFO: `/v3/services/image` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.754111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.755500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:02.764736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:02.765783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:02.767321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 496/993] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:02.771448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.772720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.787452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.806865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 498/994] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:02.878001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea22a7-abb3-42a5-a071-828a0248dcf7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.913456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.914087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.914372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.914863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.915495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] RBAC: Adding query filter params (name=image) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:02.915804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.917153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.927639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 497/995] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:02.931543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.031065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e47a78-dd11-4daa-8629-7ad3a0a06e74 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.064118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.064719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.065093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.065370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.065993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] RBAC: Adding query filter params (type=image) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.066295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.067682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.078765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 499/996] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.079828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.168842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.193934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa0d42-66dc-49d2-b4e6-6d24ebf76219 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.233040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.233680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.234196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.234196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.234865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.236345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:03.245536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:03.246999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:03.247860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 498/997] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:03.252957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.289313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.357104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a8a1-00a7-4d5a-a72f-4e2ca0136b85 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.392345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.392960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.393245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.393523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.394156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.394481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.395857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.406188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 500/998] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.407528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.509153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965669-2999-4bb8-bb46-b0500387ac56 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.544769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.545649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.545931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.546200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.546853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.547158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.548517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3ee80-dd0a-416f-8595-ab91384a9336 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.558834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 499/999] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.560227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.659160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.663708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84196-cfcb-42fc-85d2-10f34f6e5e46 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.698987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ac2e5-6795-4d45-b59f-b5ab9d5c0893 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.699277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.699478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ac2e5-6795-4d45-b59f-b5ab9d5c0893 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.699645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ac2e5-6795-4d45-b59f-b5ab9d5c0893 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.699914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.700153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.700430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.701003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 500/1000] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:03.701259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] RBAC: Adding query filter params (interface=public, service_id=16a2cd1940db4a2495aa06ef28f62a36, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.701579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.703104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.705649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.705939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.706211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.709013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 501/1001] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/endpoints?service_id=16a2cd1940db4a2495aa06ef28f62a36&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.714313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.720008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.735871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:03.737195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:03.806324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 501/1002] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:03.834285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fa9f4-e209-4be7-8772-ec7ef2b068cf None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.868984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b945476-3098-490d-86d7-0683005434df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.869596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b945476-3098-490d-86d7-0683005434df None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.869882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b945476-3098-490d-86d7-0683005434df None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.870158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b945476-3098-490d-86d7-0683005434df None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.870882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b945476-3098-490d-86d7-0683005434df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.872246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b945476-3098-490d-86d7-0683005434df None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.878733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 502/1003] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:04.070639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.173683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5117d-038c-4bd6-ac45-054fd483220c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.207756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.208394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.208679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.208954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.209638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.211022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.212835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:04.221578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:04.230175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:04.231102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 502/1004] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:04.231928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b945476-3098-490d-86d7-0683005434df None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.257668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.331950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b945476-3098-490d-86d7-0683005434df None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.365744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.366360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.366680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.366954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.367591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.367895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.369264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.379529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 503/1005] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:04.380453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.483553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712f98-90b6-4a1a-a174-260f6db999ff None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.517726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.518348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.518666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.518941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.519571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.519874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.521228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080675-ee82-41e7-b0b1-877e00788691 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.530876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 503/1006] 10.222.0.47 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:04.532568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.626600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.636943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954b1b2-d527-4f92-91ad-10d0f7e0e9d7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.670792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.671414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.671702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.671980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.672650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.674015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4af484-340f-43f2-b773-5cdcd8c5f1bd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.746317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 504/1007] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:04.995254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ce67-a146-4a29-bbfa-114c10717fdb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.995622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ce67-a146-4a29-bbfa-114c10717fdb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.996397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ce67-a146-4a29-bbfa-114c10717fdb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.997981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 504/1008] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:05.002877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f587e-5991-44ed-a216-e48b3b641210 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.003170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f587e-5991-44ed-a216-e48b3b641210 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.003446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f587e-5991-44ed-a216-e48b3b641210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.022287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5c2f587e-5991-44ed-a216-e48b3b641210 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:05.023485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5c2f587e-5991-44ed-a216-e48b3b641210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:05.098199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 505/1009] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:05.364996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89ce67-a146-4a29-bbfa-114c10717fdb None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.427599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.468373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89ce67-a146-4a29-bbfa-114c10717fdb None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.501921 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.502593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.502875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.503144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.503798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.505140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5630-b814-49c3-9551-5c9b0b88cfe5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.606795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 505/1010] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:05 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:05.849752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8311a-63b2-4fd1-897b-36c540f37049 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.850251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8311a-63b2-4fd1-897b-36c540f37049 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.850357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8311a-63b2-4fd1-897b-36c540f37049 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.851806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 506/1011] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:05.857213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.857508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.857784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.877381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:05.878629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:05.957091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 506/1012] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:06.226850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8311a-63b2-4fd1-897b-36c540f37049 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.306621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.331618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8311a-63b2-4fd1-897b-36c540f37049 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.366694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.367334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.367617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.367888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.368485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.369837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:06.379489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:06.380507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:06.381376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:06.389073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 507/1013] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:06.389214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.436554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.488107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc450a79-720d-44f1-9913-59f16da8e3dc None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.522498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.523107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.523387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.523659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.524286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:06.524588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.525942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.536088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 507/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.537252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.641534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035e40-d9b9-4f3c-8475-6978759c50e5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.676188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.676802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.677085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.677358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.677991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:06.678297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.679689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c459231-9f35-4a48-bda5-023da1ae8d09 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.689387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 508/1015] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.690924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.709465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8db3-5ac6-45b6-a2aa-8090dcf359f4 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.709760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8db3-5ac6-45b6-a2aa-8090dcf359f4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.710027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8db3-5ac6-45b6-a2aa-8090dcf359f4 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.711543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 509/1016] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:06.716730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.717007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.717280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.724368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.736982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:06.740710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:06.798110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890a41-284f-4119-abc0-6d569a2b0241 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.811647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 510/1017] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:06.817892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.841508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.841508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.841508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.841508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.841862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.841862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.924390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 508/1018] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:07.078909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.186361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dd9b-0b06-4fd6-bb3f-b9d465470312 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.222300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.228720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.229517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.229966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.230403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.231659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.233374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a903d-6f86-4c44-b417-31b7a58c1afd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.236676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 511/1019] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:07.241027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.344052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d38a-b853-486d-a02d-cff69afaa141 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.377274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.377882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.378163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.378434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.379119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.380568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607504-f4ff-49bb-9bb0-9bac015cca65 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.469022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 509/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:07 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:07.566123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4b87-49fd-473a-bfe4-79569fff72d2 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.566491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4b87-49fd-473a-bfe4-79569fff72d2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.566743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4b87-49fd-473a-bfe4-79569fff72d2 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.568399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 512/1021] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:07.575022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e0f2a-f2be-498a-b245-96641411181a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.575446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e0f2a-f2be-498a-b245-96641411181a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.575729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e0f2a-f2be-498a-b245-96641411181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.596045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-545e0f2a-f2be-498a-b245-96641411181a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:07.597184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-545e0f2a-f2be-498a-b245-96641411181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:07.614410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.675334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 510/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:07.951770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4b87-49fd-473a-bfe4-79569fff72d2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.059774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4b87-49fd-473a-bfe4-79569fff72d2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.094792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.095443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.095700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.095973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] PATH_INFO: `/v3/services/image` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.096561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.097935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.106880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.107876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:08.108725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:08.110761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 513/1023] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.113942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e0f2a-f2be-498a-b245-96641411181a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.216831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e0f2a-f2be-498a-b245-96641411181a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.250301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.250930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.251213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.251485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.252112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] RBAC: Adding query filter params (name=image) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.252414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.253782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.258652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 511/1024] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.264913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.326470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.363614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389eb4-8729-4962-b329-99643b258776 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.397571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.398187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.398492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.398774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.399441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] RBAC: Adding query filter params (type=image) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.399750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.401113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.411725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 514/1025] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.412641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.431828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.522908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2103-432a-4632-95a1-09a894006b99 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.559125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.559743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.560027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.560305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.561010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] RBAC: Adding query filter params (interface=public, service_id=f80041fd0bd044549e423ec112830043, region_id=RegionOne) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.561319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.562702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ac793-f844-4318-8f2e-506cc76b8042 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.572586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 512/1026] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/endpoints?service_id=f80041fd0bd044549e423ec112830043&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.574116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.681844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2da5-c7b6-4b59-8608-1416f6d07deb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.707658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.717437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.718050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.718333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.718637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.719246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.720794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c2827-856f-4981-818b-09da12aaf2e4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.734808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 515/1027] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:38:08.983505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c2e8-b027-4e4d-9ad5-feb0d96a4c40 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.983783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c2e8-b027-4e4d-9ad5-feb0d96a4c40 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.984052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c2e8-b027-4e4d-9ad5-feb0d96a4c40 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.985383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 513/1028] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:08.990536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec3c7-c299-4fc6-a21b-ef61f7acfbe4 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.990786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec3c7-c299-4fc6-a21b-ef61f7acfbe4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.991063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec3c7-c299-4fc6-a21b-ef61f7acfbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.009442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cddec3c7-c299-4fc6-a21b-ef61f7acfbe4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:09.010647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cddec3c7-c299-4fc6-a21b-ef61f7acfbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.080820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 516/1029] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:09.351247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6c2e8-b027-4e4d-9ad5-feb0d96a4c40 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.434901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.457948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6c2e8-b027-4e4d-9ad5-feb0d96a4c40 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.490227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7397c-153f-4a1b-9b2d-7cc6c03b5cc3 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.490760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7397c-153f-4a1b-9b2d-7cc6c03b5cc3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.490926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7397c-153f-4a1b-9b2d-7cc6c03b5cc3 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.492262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 517/1030] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:09.493082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.493725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.494007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.494281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.498031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.498321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.498634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.505285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:09.512122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.513048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:09.515403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 514/1031] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.517670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:09.518957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.519077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.586430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 518/1032] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:09.630168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdacd9-0c8f-410c-83f7-2fa326f3a073 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.665037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.665647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.665933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.666208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.666899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:09.667238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.668715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.674219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.682512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 515/1033] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:09.684378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.735680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.785659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe05cb-2c8a-4c3b-99a4-88e8029e9ca0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.832609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.833262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.833543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.833818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.844091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.845535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:09.861079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.862036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:09.863358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:09.863358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:09.863358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:09.863358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 519/1034] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.868015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.868149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.974360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63712023-a384-4441-a75b-3e8e6e48bbd4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.975189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f82cab-12d8-4c65-bd2b-92ca8017a131 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.977797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.011074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.011540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.011775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.012062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.012176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.012488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.012600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.012752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.013038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.013716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.013834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.015270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.015687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.016961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 516/1035] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.022451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.034111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 520/1036] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:10.035174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.099779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.136560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479106-f8ba-402e-b4e3-9dcfd730bc3b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.136787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952aaee-4e83-4daa-9181-19ab1d7a3ff5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.173649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.174253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.174560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.174832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.175470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.176570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.176903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.177201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.177482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.177754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.184895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.186312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:10.198864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:10.204459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:10.205610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 521/1037] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:10.207343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.231779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.284232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 517/1038] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:10 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:10.308995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2955d-3d7e-4aa3-8e9d-d15c6113a9a0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.348602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.349230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.349509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.349779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.350569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.350879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.352328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34d49-82c4-4bb5-a9a3-526878d8a144 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.372468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 522/1039] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.382468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.491273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0592-8988-4525-9ae9-ff94aa7673f2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.516873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.528077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.528692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.528976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.529250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.598464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.599923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.665214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2025-a203-4d87-a18e-6141a3652437 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.665742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2025-a203-4d87-a18e-6141a3652437 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.665742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2025-a203-4d87-a18e-6141a3652437 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.667347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 523/1040] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:10.672335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.672629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.672916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.691563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:10.692762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:10.703700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 518/1041] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:10.709140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.733450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.774805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 524/1042] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:10.812587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae141b-9689-4cca-b4bb-e1344398ac9c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.851662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.852296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.852579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.852854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.863593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.865036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:10.880256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:10.881219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:10.886873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:10.886873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:10.886873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:10.886873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 519/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:10.887121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.899478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.988658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1a54-2e18-4b13-ad86-49e376a1d930 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.022766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.023377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.023662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.023940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.024590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.024956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.026295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.036816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.042772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 525/1044] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:11.043733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.119857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.122914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.144241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd81e7-5d6c-4f9c-bf98-f4403c9ae405 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.153847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824a0a3-fca5-44c5-939a-2c79d96d91d5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.178778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.179413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.180284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.180284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] PATH_INFO: `/v3/services/image` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.180546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.181909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.188460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.189090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.189375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.189650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:11.190764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:11.191999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:11.192888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 520/1045] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:11.197682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.199890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.201358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:11.213000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:11.214639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:11.215577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 526/1046] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:11.220882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.307562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76db0-5274-4dc6-8d6b-855f0e9fcce2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.327296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd6711-5ba9-4263-84b7-4ec490575207 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.343218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.344036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.344489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.344908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.345735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] RBAC: Adding query filter params (name=image) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.346319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.347851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.353329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 521/1047] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:11.358636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.359422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.363255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.364540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.365217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.365564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.365904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.366695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.367067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.368555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.381942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 527/1048] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:11.388614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.465959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ca85a-ac01-48c4-aac1-7dc022cda5da None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.500391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.501002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.501286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.501560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.502194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] RBAC: Adding query filter params (type=image) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.502528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.502859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb2547-69e7-44bd-977a-78de9af504f4 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.503895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.508906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 522/1049] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:11.515147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.539864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.540668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.541221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.541638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.543149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] RBAC: Adding query filter params (role.id=0550ae856cff42c88708b154ea85e1b2, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.543616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.545645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd262d-0398-4837-b34e-174462bc00aa None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.551518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 528/1050] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=0550ae856cff42c88708b154ea85e1b2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:11.596504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.630640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199d3-a59f-4b63-9554-32feeb517b59 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.668184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.668820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.669105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.669639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.670326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.671761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c921d-cbd3-4401-88e2-4f59bd7cdd76 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.775239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 523/1051] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:12.282658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90bd-0c3e-4978-ba00-1702dc0de3f2 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.283194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90bd-0c3e-4978-ba00-1702dc0de3f2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.283194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e90bd-0c3e-4978-ba00-1702dc0de3f2 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.284685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 529/1052] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:12.289643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.289942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.290223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.308925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:12.310120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:12.384514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 524/1053] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:12.655721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e90bd-0c3e-4978-ba00-1702dc0de3f2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.712468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.757631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e90bd-0c3e-4978-ba00-1702dc0de3f2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.792307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.793207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.793690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.794139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.804731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:12.809731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:12.810837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:12.811874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:12.813940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 530/1054] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:12.820022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.872760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.925127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb16ee1-e51c-4c49-b959-75693d8894ab None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.958880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.959493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.959778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.960053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.960720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:12.961026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.962394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.975946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 525/1055] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:12.977575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.082654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4636c-d2ea-490b-9ac0-859faff34d19 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.097578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.118800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.119934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.119934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.120273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] PATH_INFO: `/v3/users/8898aac942914165a2895966c624b08b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.133892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8898aac942914165a2895966c624b08b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.136319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eba00-0ae9-4ad3-ba69-4e2c694124b7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.142515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 531/1056] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/users/8898aac942914165a2895966c624b08b => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:13.145774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.253192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b23f1-e4b1-42dc-9f36-9122d88d387c None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.266559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.287652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.288266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.288552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.288831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.359090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.360540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.464977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 526/1057] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:13.465186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9b3d-6009-432a-9aee-234490a1ead4 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.465186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9b3d-6009-432a-9aee-234490a1ead4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.465186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9b3d-6009-432a-9aee-234490a1ead4 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.465708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 532/1058] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:13.466011 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.471399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.471769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.472123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.480612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.490419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:13.491718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:13.564015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 533/1059] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:13.571704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d0b1-1635-4b6c-8bae-e73d7f13124f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.607530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.608164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.608447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.608722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.609927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.611390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2ac23-c4b2-4527-bb5e-1d103c358a71 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.617983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 527/1060] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:13.619201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.719850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c3fea-667e-4daa-bf49-39f4bbc9adcb None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.721380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.756683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.757299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.757583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.757858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.758623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=0289cb473d9545408e83bbd6b301ce80, user.id=8898aac942914165a2895966c624b08b) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:13.758938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.760869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8a20-7cc0-4a29-8bce-f9fa83197096 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.774643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 534/1061] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/role_assignments?user.id=8898aac942914165a2895966c624b08b&scope.project.id=0289cb473d9545408e83bbd6b301ce80&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:13.774848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c40c-ef64-4c01-b88f-5a5e4554dad7 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.774848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c40c-ef64-4c01-b88f-5a5e4554dad7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.774848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c40c-ef64-4c01-b88f-5a5e4554dad7 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.774848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 528/1062] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:13.779092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.779381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.779660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.799949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:13.801168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:13.833971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c40c-ef64-4c01-b88f-5a5e4554dad7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.881482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 535/1063] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:13.929701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.950181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c40c-ef64-4c01-b88f-5a5e4554dad7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.985049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.985680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.985964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.986240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.996399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:14.001231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.002144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:14.003589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 529/1064] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:14.008257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.104848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.111398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812927-df3c-4b1d-885e-5c6f07c898f7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.145976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189d74-b288-446e-9a66-965681890c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.146620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189d74-b288-446e-9a66-965681890c4d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.146909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189d74-b288-446e-9a66-965681890c4d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.147187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189d74-b288-446e-9a66-965681890c4d None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.147859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189d74-b288-446e-9a66-965681890c4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.148228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189d74-b288-446e-9a66-965681890c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.149604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189d74-b288-446e-9a66-965681890c4d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.154786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.162562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 536/1065] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.164087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189d74-b288-446e-9a66-965681890c4d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.263350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30229a3-f1ae-4dc4-b250-db4f1c8188b8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.279803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189d74-b288-446e-9a66-965681890c4d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.300542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.301155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.301436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.301711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.313357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.316633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.317259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.317537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.317844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.329105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.330564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:14.346084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.347107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:14.348021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:14.348021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.348021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:14.348021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 537/1066] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:14.352925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.366549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.377121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.378617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.461062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f942-c40d-48bf-9fa7-6991235eac44 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.490494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 530/1067] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:14.493416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.495939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.496565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.496851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.497129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.497856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.498167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.499575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.517571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 538/1068] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:14.518752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.536159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.592473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.595756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4c522-9ab0-4d09-9606-36018c53a775 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.622764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba19fd-2584-4c1c-95d6-fa6a10754a73 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.635880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.636540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.636826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.637100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.648390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.649839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.659617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.660275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.660561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.660834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:14.666052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.667072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:14.668003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:14.668003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.668003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:14.669690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.671167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.672581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 531/1069] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:14.673179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:14.683258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.684231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:14.685197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 539/1070] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:14.690370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.774984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.784472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fca4-40f0-47f2-98ef-1a9722c758dd None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.797115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde38e4-e735-4363-82e4-5ed68c1a958f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.821408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.822015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.822295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.822609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.823780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.824099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.825470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.841089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.843197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 532/1071] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:14.851409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.857664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.876397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 540/1072] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.881858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.988548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3f8b0-4624-4db0-8985-dab5ee4cfb9f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.023039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.023666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.023944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.024212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.034737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.036164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:15.050589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:15.051593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:15.052562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:15.052562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:15.052562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:15.052562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 533/1073] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:15.059886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.167532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ec6e3-bef4-4ab3-8516-64a413b8be51 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.199901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.200503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.200781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.201050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.201693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:15.201992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.203388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.214799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 541/1074] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:15.220460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.224213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.318997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4519aa-1e38-4957-a350-38eeec163da9 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.352666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.353292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.353599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.353873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.360529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.361958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:15.373342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:15.374421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:15.375399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 534/1075] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:15.380238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.429058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.480056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed94751-ab63-4f2c-940d-93cfe3c73a8d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.512921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.513528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.513798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.514072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.514841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:15.515153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.516578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357826-fbec-42bb-969a-2a17bcae81dd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.528868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 542/1076] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:15.534868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.596437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.634731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafaa26-411a-483a-8c26-04ff173606d3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.667651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.668308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.668589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.668863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/0550ae856cff42c88708b154ea85e1b2` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.671268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=36f965f6675e44c3921178931ae00caf, role_id=0550ae856cff42c88708b154ea85e1b2)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.672687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.689379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9ebdd-8898-4eca-82ec-7f2ab68fd248 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.689379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9ebdd-8898-4eca-82ec-7f2ab68fd248 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.689379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9ebdd-8898-4eca-82ec-7f2ab68fd248 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.689379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 543/1077] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:15.691088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467104-7c80-47d0-9828-33237452f88b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.691375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467104-7c80-47d0-9828-33237452f88b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.691651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467104-7c80-47d0-9828-33237452f88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.709829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-43467104-7c80-47d0-9828-33237452f88b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:15.711037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-43467104-7c80-47d0-9828-33237452f88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:15.759520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 535/1078] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:15 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/36f965f6675e44c3921178931ae00caf/roles/0550ae856cff42c88708b154ea85e1b2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:38:15.779477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 544/1079] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:16.046839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.146635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dab1a-e2f9-47ee-9b5a-43ee4a8b1332 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.169885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.180511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.181137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.181449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.187214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.192837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:16.197663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:16.199171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:16.200041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 536/1080] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:16.204793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467104-7c80-47d0-9828-33237452f88b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.243679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.301698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467104-7c80-47d0-9828-33237452f88b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.334136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.334772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.335054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.335326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.335989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:16.336292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.337652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.345718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 545/1081] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.351488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.448662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e3b47-039e-432c-a0cf-59fc13371589 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.481355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.481982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.482268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.482577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] PATH_INFO: `/v3/users/8898aac942914165a2895966c624b08b` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.483683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] RBAC: Authorizing `identity:get_user(user_id=8898aac942914165a2895966c624b08b)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.485096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.486688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 537/1082] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/users/8898aac942914165a2895966c624b08b => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.492428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.585192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.588718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c076-425a-4298-9615-322a7f541a9f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.625208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.625828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.626106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.626379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.627500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.628919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7204d-8c7e-48bf-9168-c72e616c4ff6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.630696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 546/1083] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.637447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.688962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.736725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e95de-1a8e-4403-90a6-7908a61f85d5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.769336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.769991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.770274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.770576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80/users/8898aac942914165a2895966c624b08b/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.772458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] RBAC: Authorizing `identity:create_grant(project_id=0289cb473d9545408e83bbd6b301ce80, user_id=8898aac942914165a2895966c624b08b, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.773878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721139-5680-4054-ba2d-a63f70f6192c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.842715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 538/1084] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:16 2022] PUT /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80/users/8898aac942914165a2895966c624b08b/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:17.637743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca60bc-5bda-4629-8a8f-e475b0d41bc2 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:17.638323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca60bc-5bda-4629-8a8f-e475b0d41bc2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:17.638323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca60bc-5bda-4629-8a8f-e475b0d41bc2 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:17.639640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 547/1085] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:17.644979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:17.645375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:17.645658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:17.664735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:17.665918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:17.732754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 539/1086] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:18.012751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca60bc-5bda-4629-8a8f-e475b0d41bc2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.111294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca60bc-5bda-4629-8a8f-e475b0d41bc2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.144585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.145214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.145498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.145771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.156439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:18.161238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:18.162158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:18.163193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 548/1087] 10.222.0.47 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:18.168511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.210028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.265130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae71a-5047-4182-9e64-ef0bfefa5e93 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.301248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.301852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.302133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.302405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.303125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:18.303431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.304780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.313100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 540/1088] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:18.318755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.347188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.416817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218abc1-3e20-4d48-8863-4a2a4a202294 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.449068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.449692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.449973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.450245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.460241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.461665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:18.476800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:18.477948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:18.479476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:18.479476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:18.479476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:18.479476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 549/1089] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:18.484271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.581728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c86e9-1be0-439c-b598-a49d7d415170 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.583974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.615522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.616125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.616405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.616680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.617326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:18.617628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.619035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3de1-da1b-43e9-890c-0efed7aca3fd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.630726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 541/1090] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:18.636452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.716027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.717254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abbee9-ea46-4c3d-a84c-02f1609a3cfb None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.717693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abbee9-ea46-4c3d-a84c-02f1609a3cfb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.717837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abbee9-ea46-4c3d-a84c-02f1609a3cfb None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.719156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 542/1091] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:18.724177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.724405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.724682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.735754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d917a-f425-47d8-99f6-6742a8dc010c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.743802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:18.745247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:18.768847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.769475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.769760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.770039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.778798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.780232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:18.791083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:18.792788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:18.794757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 550/1092] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:18.798754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.812494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 543/1093] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:18.897455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7872-55c5-41e2-ba73-176731fa5744 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.930049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.930677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.930957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.931231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.932125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:18.932461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.933873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.942568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.950459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 551/1094] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:18.956354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.047454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.053824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7bc4-c5c2-48dd-a0be-87c9c001c844 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.087005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.088759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.089394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.089689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.089967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.157108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.158485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.188827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e48e9-a48d-493e-812a-e6998ef5bf57 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.223977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.224606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.224891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.225166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.235813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:19.240629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:19.241756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:19.242655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 552/1095] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:19.247617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.249746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.262791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 544/1096] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:19.263799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.305887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.346829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65e23a-ab4d-40ca-8395-b3c8ff1493b2 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.360655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82544dca-d817-4c18-9119-626d0dd6ddd2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.379627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.380236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.380520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.380797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.381466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.381771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.383181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.391757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 553/1097] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:19.396537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.396671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.396836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.397109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.397381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.406991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.408473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:19.423420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:19.424399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:19.425323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:19.425323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:19.425323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:19.425323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 545/1098] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:19.430156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.474878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.496190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04db9-15a7-4183-b15d-8cd34cb23027 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.517190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.528396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f313c60-8233-46f0-b58a-ff5628d70f43 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.531969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.532593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.532880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.533156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] PATH_INFO: `/v3/users/8898aac942914165a2895966c624b08b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.534302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] RBAC: Authorizing `identity:get_user(user_id=8898aac942914165a2895966c624b08b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.535772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.537351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 554/1099] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/users/8898aac942914165a2895966c624b08b => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:19.543120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.563245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.563880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.564162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.564434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.565071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.565400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.566783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.578849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 546/1100] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:19.584339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.643834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ee5f-9b48-446f-825f-6bdcc417d87e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.677347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.677885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.678177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.678472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.679739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c64dc-9260-4ac9-81b5-ee619e18f34a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.687546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.714100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.714758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.715046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.715323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.721832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.723344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.734169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:19.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:19.736290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:19.737226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 547/1101] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:19.742214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.748222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.749770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.842382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99bbb7-95c0-4c0a-9b66-83a8ba5ba3e1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.859495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 555/1102] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:19.860510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.875903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.876511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.876793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.877062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.877747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.878054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.879541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.891303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 548/1103] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:19.897164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.923208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.950001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.961474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5c8a-d7ab-49e2-b5ce-307fdfa08c45 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.995684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.996309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.996419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b8af5-45ca-4fd1-ade8-60b1d18756ff None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.996586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.996854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.997950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.999540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.001146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 556/1104] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:20.007425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.030878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.031487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.031772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.032050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.032773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] RBAC: Adding query filter params (role.id=0550ae856cff42c88708b154ea85e1b2, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=36f965f6675e44c3921178931ae00caf) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.033082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.034512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183153d7-2a90-402f-827b-1f3b6b498f46 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.040434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 549/1105] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/role_assignments?user.id=36f965f6675e44c3921178931ae00caf&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=0550ae856cff42c88708b154ea85e1b2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:20.109434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bfa6b-ea67-4ac5-b7a5-b496fc8c770c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.145147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.145769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.146051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.146321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.147121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=0289cb473d9545408e83bbd6b301ce80, user.id=8898aac942914165a2895966c624b08b) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.147429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.148876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc8fb6-4fef-448d-93b0-30a79be0498b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.156155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 557/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/role_assignments?user.id=8898aac942914165a2895966c624b08b&scope.project.id=0289cb473d9545408e83bbd6b301ce80&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:22.095308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede3053-99f4-4915-99be-27200d043024 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.095806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede3053-99f4-4915-99be-27200d043024 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.095806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede3053-99f4-4915-99be-27200d043024 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.097084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 550/1107] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:22.102121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.102546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.102715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.120501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:22.121670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:22.135651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.185863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 558/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:22.459240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede3053-99f4-4915-99be-27200d043024 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.547636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.558333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede3053-99f4-4915-99be-27200d043024 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.591263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.591885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.592178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.592449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.593567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.597315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f5399-6905-4a8f-8cd0-62e178ea80c9 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.597315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 551/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:22.602155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.760372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87bb5-5239-4eef-8fb9-1b68a34c6a64 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.794242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.794864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.795145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.795413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.796061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.797523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105922f-ca34-46e0-a4ac-2c661f8bf819 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.937085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 559/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:22 2022] POST /identity/v3/users => generated 286 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:24.871211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df236-1af9-46d3-a8bd-076b5da328e1 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.871667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df236-1af9-46d3-a8bd-076b5da328e1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.871780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df236-1af9-46d3-a8bd-076b5da328e1 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.873074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 552/1111] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:24.878372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.878786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.878951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.892268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:24.897733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:24.898960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:24.963666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 560/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:25.238934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38df236-1af9-46d3-a8bd-076b5da328e1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.338120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38df236-1af9-46d3-a8bd-076b5da328e1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.370218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.370852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.371130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.371400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] PATH_INFO: `/v3/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.372758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] RBAC: Authorizing `identity:get_role(role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.374107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.375402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 553/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.381011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.476762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd660-ca98-44bc-ba09-39c4e74cf9ef None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.513266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.513824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.514105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.514374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] PATH_INFO: `/v3/users/87396e244ddd498b903c94ef4ce9fbee` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.517008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.527687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] RBAC: Authorizing `identity:get_user(user_id=87396e244ddd498b903c94ef4ce9fbee)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.529124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.530753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 561/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/users/87396e244ddd498b903c94ef4ce9fbee => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.536499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.563593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.633302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbbbcc-6fb2-4de4-9cb9-ee750dc25012 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.665640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.666239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.666543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.666818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.730725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.732137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.756897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.836004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 554/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:25.837556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.932318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136b439-72c4-4460-b701-8c3ad58d2f33 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.964735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.965358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.965643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.965919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.967037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.968536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399a828-d078-47fe-a260-291e4fa4c2ab None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.970149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 562/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.976418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:26.072537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a486b0-7e20-4102-9131-b498d79f832b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:26.096230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:26.105106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=0289cb473d9545408e83bbd6b301ce80, user.id=87396e244ddd498b903c94ef4ce9fbee) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:26.109264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d381-6afc-49c9-955c-edbffb4bcb5e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:26.113889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 555/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/role_assignments?user.id=87396e244ddd498b903c94ef4ce9fbee&scope.project.id=0289cb473d9545408e83bbd6b301ce80&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:27.973352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0513b8-bbe9-4e76-b5cb-1244e794a2a7 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.973873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0513b8-bbe9-4e76-b5cb-1244e794a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.973972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0513b8-bbe9-4e76-b5cb-1244e794a2a7 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:27.975404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 563/1118] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:27.981141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.981582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.981682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.000992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:28.002162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:28.066596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 556/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:28.330818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0513b8-bbe9-4e76-b5cb-1244e794a2a7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.391819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.429568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0513b8-bbe9-4e76-b5cb-1244e794a2a7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.463065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.463681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.463965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.464240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] PATH_INFO: `/v3/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.465606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] RBAC: Authorizing `identity:get_role(role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.466995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.468301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 564/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:28.474022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.569402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec789-c3e9-40fc-9af4-56d39c270552 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.589325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.602630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.603405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.603687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.603959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] PATH_INFO: `/v3/users/87396e244ddd498b903c94ef4ce9fbee` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.605066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] RBAC: Authorizing `identity:get_user(user_id=87396e244ddd498b903c94ef4ce9fbee)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.606526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.608072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 557/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/users/87396e244ddd498b903c94ef4ce9fbee => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:28.613931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.710920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be020c-efd3-425b-bc2a-d596e86a3346 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.739105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.745258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.749958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.749958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.749958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.749958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.749958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908712a-8629-47cd-9720-a9abe81fec20 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.750737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 565/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:28.756633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.852517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c7a2-3a8f-4de4-8c98-b91dd54ac0ff None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.885284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.885932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.886210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.886515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80/users/87396e244ddd498b903c94ef4ce9fbee/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.888599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] RBAC: Authorizing `identity:create_grant(project_id=0289cb473d9545408e83bbd6b301ce80, user_id=87396e244ddd498b903c94ef4ce9fbee, role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.890005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42908f3-f377-4de9-a0da-8b396c096654 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.998311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 558/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:28 2022] PUT /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80/users/87396e244ddd498b903c94ef4ce9fbee/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:30.855358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5eb24-94ea-416a-97b8-14db3677534d None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.855796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5eb24-94ea-416a-97b8-14db3677534d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.855889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5eb24-94ea-416a-97b8-14db3677534d None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.857221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 566/1124] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:30.862258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.862710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.862835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.881072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:30.882237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:30.924100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:30.946080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 559/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:31.217895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5eb24-94ea-416a-97b8-14db3677534d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:31.314466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5eb24-94ea-416a-97b8-14db3677534d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:31.346973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:31.347588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.347867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.348134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] PATH_INFO: `/v3/roles/31c845de77524bdf90f9b00e6128c6e5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.349486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] RBAC: Authorizing `identity:get_role(role_id=31c845de77524bdf90f9b00e6128c6e5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:31.350859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:31.352136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 567/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:31 2022] GET /identity/v3/roles/31c845de77524bdf90f9b00e6128c6e5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:31.358884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:31.454411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214671cc-8fb4-4055-8d21-072ed547e26d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:31.487586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:31.488152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.488437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.488711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] PATH_INFO: `/v3/users/87396e244ddd498b903c94ef4ce9fbee` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.489814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] RBAC: Authorizing `identity:get_user(user_id=87396e244ddd498b903c94ef4ce9fbee)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:31.491261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:31.492788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 560/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:31 2022] GET /identity/v3/users/87396e244ddd498b903c94ef4ce9fbee => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:31.499044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:31.562714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:31.595301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03be06-2c11-4e51-94f7-5d5c102e357a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:31.628434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:31.629020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.629301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.629571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.693513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:31.694981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:31.755573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:31.788545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 568/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:31.795138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:31.840445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:31.891189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d15df-7daa-4b3c-85e3-e8ffaabb424f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:31.923735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:31.924355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.924640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.924915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] PATH_INFO: `/v3/projects/0289cb473d9545408e83bbd6b301ce80` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.926007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] RBAC: Authorizing `identity:get_project(project_id=0289cb473d9545408e83bbd6b301ce80)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:31.927449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547323bb-6e25-45ca-88d2-ea78fd136da3 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:31.929035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 561/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:31 2022] GET /identity/v3/projects/0289cb473d9545408e83bbd6b301ce80 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:31.935821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.029477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03429b6-d008-4247-8680-2481ed7e5f3f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.063403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.063992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.064272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.064546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.065272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] RBAC: Adding query filter params (role.id=31c845de77524bdf90f9b00e6128c6e5, scope.project.id=0289cb473d9545408e83bbd6b301ce80, user.id=87396e244ddd498b903c94ef4ce9fbee) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.065582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.067013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca334-7427-4d46-90ca-ccbdf52a4070 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.072521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 569/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:31 2022] GET /identity/v3/role_assignments?user.id=87396e244ddd498b903c94ef4ce9fbee&scope.project.id=0289cb473d9545408e83bbd6b301ce80&role.id=31c845de77524bdf90f9b00e6128c6e5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:33.990020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089adb-a2ff-4a23-b84e-d6678687c347 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.990570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089adb-a2ff-4a23-b84e-d6678687c347 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.990570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089adb-a2ff-4a23-b84e-d6678687c347 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:33.991908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 562/1131] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:33.997263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.997633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.997806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:34.016070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:34.017253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:34.040434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:34.082860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 570/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:34.344515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73089adb-a2ff-4a23-b84e-d6678687c347 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:34.442940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73089adb-a2ff-4a23-b84e-d6678687c347 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:34.456199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:34.475779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:34.476396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:34.476671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:34.476936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:34.478711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:34.480119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e2bb-4cec-4814-a6a2-07e61a73a01a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:34.481620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 563/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:34.487312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:34.583777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4b60-6922-4e31-bc74-aa636c4d0709 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:34.618984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:34.619597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:34.619911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:34.620189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:34.620853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:34.622279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96bc2d-af34-4ad2-97c2-2703e5f81e02 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:34.722329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 571/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:34 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:36.636865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b84-c159-4709-8348-36bfeb50a330 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:36.637411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b84-c159-4709-8348-36bfeb50a330 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:36.637411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8b84-c159-4709-8348-36bfeb50a330 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:36.638848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 564/1135] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:36.644145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361f6-b269-4091-9636-38770f1cc655 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:36.644560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361f6-b269-4091-9636-38770f1cc655 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:36.644698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625361f6-b269-4091-9636-38770f1cc655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:36.663804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-625361f6-b269-4091-9636-38770f1cc655 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:36.665773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-625361f6-b269-4091-9636-38770f1cc655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:36.673089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:36.731122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 572/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:36.998726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8b84-c159-4709-8348-36bfeb50a330 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:37.097939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8b84-c159-4709-8348-36bfeb50a330 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:37.129944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:37.130585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:37.130866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:37.131136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:37.132217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:37.134577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae3b5-0696-4a25-9479-f375135cc69e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:37.136105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 565/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:37.141990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625361f6-b269-4091-9636-38770f1cc655 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:37.236373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625361f6-b269-4091-9636-38770f1cc655 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:37.269114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:37.269690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:37.269971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:37.270242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:37.270922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:37.272335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c44aa-016b-4795-b347-b8fdb9b1baa8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:37.383951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:37.389624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 573/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:37 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:39.295942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce91e-0519-42c3-a853-5e83ea99f9dc None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.296472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce91e-0519-42c3-a853-5e83ea99f9dc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.296472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce91e-0519-42c3-a853-5e83ea99f9dc None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.297778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 566/1139] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:39.302826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becd93-731d-46e9-8b13-723045465aef None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.303191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becd93-731d-46e9-8b13-723045465aef None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.303378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becd93-731d-46e9-8b13-723045465aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.321527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b2becd93-731d-46e9-8b13-723045465aef None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:39.322741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b2becd93-731d-46e9-8b13-723045465aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:39.386759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 574/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:39.657941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce91e-0519-42c3-a853-5e83ea99f9dc None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.708755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.757660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce91e-0519-42c3-a853-5e83ea99f9dc None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.791243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.791859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.792392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.792664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.802287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:39.807775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:39.808959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:39.809971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 567/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:39.814823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2becd93-731d-46e9-8b13-723045465aef None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.910353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2becd93-731d-46e9-8b13-723045465aef None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.935840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.943307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.943913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.961842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 575/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:39.962263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.060971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-d4a9-45cf-a066-3fce04625672 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.071492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.093643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.094519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.094874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.095383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] PATH_INFO: `/v3/users/449f83cc83164436b6c022b396d67225` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.110000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=449f83cc83164436b6c022b396d67225)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.111446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.113007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 568/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/users/449f83cc83164436b6c022b396d67225 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:40.119539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.216385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a75fd-49c2-48b4-b647-e2ad75ebc674 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.247576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.248168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.248448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.248721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.302974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.312559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.313990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.408547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 576/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:40.414619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.512201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d755-2dee-449f-91fc-7b3a145fa2a2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.544805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.545423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.545703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.545975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] PATH_INFO: `/v3/projects/d8efbe4c1e7045d0be379d50870b4440` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.547094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] RBAC: Authorizing `identity:get_project(project_id=d8efbe4c1e7045d0be379d50870b4440)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.548509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accc224-15bb-41f7-9055-292af809e943 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.550083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 569/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/projects/d8efbe4c1e7045d0be379d50870b4440 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:40.556557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.642539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.651637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7da4-d5a1-4aba-989e-3432910c9aa5 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.684396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.684984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.685261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.685530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.686250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=d8efbe4c1e7045d0be379d50870b4440, user.id=449f83cc83164436b6c022b396d67225) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:40.686583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.687986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c972d-96da-427f-b4c8-1c2cc01f3d51 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.693103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 577/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/role_assignments?user.id=449f83cc83164436b6c022b396d67225&scope.project.id=d8efbe4c1e7045d0be379d50870b4440&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:42.564544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f70a-5160-487a-a173-e93499b24458 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.565069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f70a-5160-487a-a173-e93499b24458 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.565178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f70a-5160-487a-a173-e93499b24458 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.566402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 570/1147] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:42.571679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.572109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.572233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.590380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:42.591657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:42.655519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 578/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:42.921389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f70a-5160-487a-a173-e93499b24458 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.955520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.018756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f70a-5160-487a-a173-e93499b24458 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.051444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.052053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.052330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.052600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.062221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:43.066982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:43.068109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:43.068983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 571/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:43.074708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.155643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.171097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa5bd9-9ca8-47cb-9a15-b36be7ad3f07 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.204918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.205524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.205807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.206079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.206770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:43.207077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.208431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.216877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 579/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:43.222653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.314678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.320738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c3f1-4bf2-437c-94b8-8ebb25314c7a None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.354210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.354852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.355137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.355412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] PATH_INFO: `/v3/users/449f83cc83164436b6c022b396d67225` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.356517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] RBAC: Authorizing `identity:get_user(user_id=449f83cc83164436b6c022b396d67225)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.357939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.359501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 572/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/users/449f83cc83164436b6c022b396d67225 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:43.365129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.462499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357dde8-34be-4b9d-9870-99722cb1a2e8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.494786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.495400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.495683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.495959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] PATH_INFO: `/v3/projects/d8efbe4c1e7045d0be379d50870b4440` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.497053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] RBAC: Authorizing `identity:get_project(project_id=d8efbe4c1e7045d0be379d50870b4440)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.498490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684c3fc-85a3-456f-8daf-29e299496f29 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.500346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 580/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/projects/d8efbe4c1e7045d0be379d50870b4440 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:43.506079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.602066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a277b-2f04-437d-991a-ae50e1a758de None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.634054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.634717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.634996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.635264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] PATH_INFO: `/v3/projects/d8efbe4c1e7045d0be379d50870b4440/users/449f83cc83164436b6c022b396d67225/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.637104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] RBAC: Authorizing `identity:create_grant(project_id=d8efbe4c1e7045d0be379d50870b4440, user_id=449f83cc83164436b6c022b396d67225, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.638578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfa519-6ace-412c-8c45-05b93b4c079d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.725208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 573/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:43 2022] PUT /identity/v3/projects/d8efbe4c1e7045d0be379d50870b4440/users/449f83cc83164436b6c022b396d67225/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:45.627423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce717c-6b52-460d-b0b8-fc77b7fb18fe None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.627953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce717c-6b52-460d-b0b8-fc77b7fb18fe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.628064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce717c-6b52-460d-b0b8-fc77b7fb18fe None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.629317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 581/1154] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:45.635219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.635658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.635756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.653387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:45.654587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:45.671398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:45.718347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 574/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:45.986277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce717c-6b52-460d-b0b8-fc77b7fb18fe None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.002700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:46.085761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce717c-6b52-460d-b0b8-fc77b7fb18fe None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.118424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.119065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.119349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.119623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.129688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:46.134466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:46.135587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:38:46.136643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 582/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:46.141599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.236545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c592e-74f5-4c06-924f-ddd1330eac15 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.269141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.269736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.270016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.270290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.270977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:46.271286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:46.272638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:46.280602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 575/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:46.286305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.359317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:46.383342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fd2b-1dab-4334-a81e-8dfc0cbed23f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.416446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.417321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.417599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.417871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] PATH_INFO: `/v3/users/449f83cc83164436b6c022b396d67225` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.418992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] RBAC: Authorizing `identity:get_user(user_id=449f83cc83164436b6c022b396d67225)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:46.420399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:46.421938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 583/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:46 2022] GET /identity/v3/users/449f83cc83164436b6c022b396d67225 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:46.427833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.445809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:46.523957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0375620-a03f-410f-aa46-0c81ff90ef15 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.556747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.557337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.557616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.557887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.622402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:46.623866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:46.639667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:46.718064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 576/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:46.724094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.822394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7b34-8893-43f3-91cc-901ae8482e1e None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.855343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.855971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.856253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.856527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] PATH_INFO: `/v3/projects/d8efbe4c1e7045d0be379d50870b4440` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.857620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] RBAC: Authorizing `identity:get_project(project_id=d8efbe4c1e7045d0be379d50870b4440)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:46.859074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a5fdc-648c-41e7-9d03-274e3fbc9968 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:46.860685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 584/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:46 2022] GET /identity/v3/projects/d8efbe4c1e7045d0be379d50870b4440 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:46.866809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:46.963438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2e9e6-bc5f-4d62-a7b2-d8f04ff4cbe1 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:46.978667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:46.995278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:46.995875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.996162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.996438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.997160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=d8efbe4c1e7045d0be379d50870b4440, user.id=449f83cc83164436b6c022b396d67225) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:46.997472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:46.998952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f16a6-9878-4adb-8db5-b376cdf9dd52 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:47.004408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 577/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:46 2022] GET /identity/v3/role_assignments?user.id=449f83cc83164436b6c022b396d67225&scope.project.id=d8efbe4c1e7045d0be379d50870b4440&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:48.952517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df32c1-519a-4d7a-99b8-f473f342b8a1 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.953010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df32c1-519a-4d7a-99b8-f473f342b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.953099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df32c1-519a-4d7a-99b8-f473f342b8a1 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.954436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 585/1162] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:48.959574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.959944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.960701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.979332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:48.980508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:49.045512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 578/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:49.311847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df32c1-519a-4d7a-99b8-f473f342b8a1 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.325067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.410576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df32c1-519a-4d7a-99b8-f473f342b8a1 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.442449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.443061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.443341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.443611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.507375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.508799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.519094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.602155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 586/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:49.608152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.703990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d67d39-a669-46e0-9da3-129f1e1efa6e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.714409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.736970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.737595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.737874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.738144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.745859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.747309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-2471ce34-2a16-4280-a55c-ab2c6cf0178d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:49.758840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:49.760022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:38:49.761083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 579/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:49.765934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.861818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec0e0-ba93-4fd0-8c3b-fa99e245133d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.872668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.894675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.895278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.895564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.895840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.896486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:49.896817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.898172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ce281-e87d-4399-b7f2-b91964048fde None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.905367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 587/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:51.785934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc5cb-a509-4daf-ac4a-845364a20afa None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:51.786502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc5cb-a509-4daf-ac4a-845364a20afa None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:51.786502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc5cb-a509-4daf-ac4a-845364a20afa None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:51.787819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 580/1167] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:51.793451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c494a8-2b74-4133-9339-fbeb58ecb600 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:51.793859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c494a8-2b74-4133-9339-fbeb58ecb600 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:51.794005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c494a8-2b74-4133-9339-fbeb58ecb600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:51.812357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-17c494a8-2b74-4133-9339-fbeb58ecb600 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:51.813531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-17c494a8-2b74-4133-9339-fbeb58ecb600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:51.878794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 588/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:52.145738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc5cb-a509-4daf-ac4a-845364a20afa None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:52.245814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc5cb-a509-4daf-ac4a-845364a20afa None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:52.277746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:52.278342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:52.278650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:52.278919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:52.279567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:52.280911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9b26d-a7eb-4036-b8da-aa461bdbe0ae None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:52.369722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 581/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Tue Aug 30 14:38:52 2022] POST /identity/v3/domains => generated 267 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:54.276624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99b8-ae42-4eba-8b2b-a05cfeb98279 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.277137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99b8-ae42-4eba-8b2b-a05cfeb98279 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.277250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99b8-ae42-4eba-8b2b-a05cfeb98279 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.278538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 589/1170] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:54.283885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.284295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.284435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.302418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:54.303627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:54.326463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.367234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 582/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:54.632864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b99b8-ae42-4eba-8b2b-a05cfeb98279 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:54.732683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b99b8-ae42-4eba-8b2b-a05cfeb98279 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.734976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.764999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.765625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.765908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.766183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] PATH_INFO: `/v3/domains/4cbae4a7d53e4e61b23c000d5a95dfc2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.776820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4cbae4a7d53e4e61b23c000d5a95dfc2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.778251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf188b-aaad-44e7-a574-01586868c161 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:54.779857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 590/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Tue Aug 30 14:38:54 2022] GET /identity/v3/domains/4cbae4a7d53e4e61b23c000d5a95dfc2 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:54.785614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:54.882175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ec43-da02-42cb-b27f-43b1e7ee5a9d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.915145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.915686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.916235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.916508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.917162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.918604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad352-a94b-4a7e-b333-993958a38988 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:55.002727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 583/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:54 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:56.924104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d464c7-3ac1-4817-9dff-20bca5414c53 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:56.924636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d464c7-3ac1-4817-9dff-20bca5414c53 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:56.924636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d464c7-3ac1-4817-9dff-20bca5414c53 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:56.925976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 591/1174] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:56.931366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:56.931807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:56.931914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:56.949789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:56.950981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:56.957988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:57.015072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 584/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:57.284089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d464c7-3ac1-4817-9dff-20bca5414c53 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:57.382487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d464c7-3ac1-4817-9dff-20bca5414c53 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.414877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b0557-867b-4da3-96ff-388084252959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.415498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b0557-867b-4da3-96ff-388084252959 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.416038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b0557-867b-4da3-96ff-388084252959 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.416314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b0557-867b-4da3-96ff-388084252959 None admin] PATH_INFO: `/v3/domains/4cbae4a7d53e4e61b23c000d5a95dfc2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.417423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b0557-867b-4da3-96ff-388084252959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4cbae4a7d53e4e61b23c000d5a95dfc2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.418880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b0557-867b-4da3-96ff-388084252959 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.420417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 592/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Tue Aug 30 14:38:57 2022] GET /identity/v3/domains/4cbae4a7d53e4e61b23c000d5a95dfc2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:57.425931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:57.519451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31dcca-9e8c-47a2-9d49-489c28caf85b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.551984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.552522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.552803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.553149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.553832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.555257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140a96-6218-412a-ba36-dedba25d3f86 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.671194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:57.676568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 585/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:57 2022] POST /identity/v3/users => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:59.647745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41518c-f8be-42c6-9071-934ffeb3ad94 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:59.648310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41518c-f8be-42c6-9071-934ffeb3ad94 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:59.648310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41518c-f8be-42c6-9071-934ffeb3ad94 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:59.649632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 593/1178] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:59.655365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:59.655793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:59.655919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:59.674330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:59.675538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:59.738342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 586/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:00.007566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41518c-f8be-42c6-9071-934ffeb3ad94 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.039372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.107265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41518c-f8be-42c6-9071-934ffeb3ad94 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.139156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.139775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.140053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.140321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.150990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:00.155678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:00.156873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:39:00.158134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 594/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:39:00.163475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.260770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbedb4-144f-4871-b0d1-97de067638a4 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.286635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.295274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.295884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.296166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.296437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.297098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:00.297403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.298786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.307203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 587/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:00.313124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.401524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.410194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976bbd-6b23-42b7-8e8a-1d23fb387d68 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.443658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.444207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.444488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.444762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] PATH_INFO: `/v3/users/f5fe95a7907644feb3e181b80c9ff401` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.457219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5fe95a7907644feb3e181b80c9ff401)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.458683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.460286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 595/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/users/f5fe95a7907644feb3e181b80c9ff401 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:00.466129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.562226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32e9a-e5cb-4951-b511-d78c09e0de57 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.595927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.601104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.601104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.601104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.653376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.663355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.664789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.758789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 588/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:39:00.764752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.861368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440311a-3cc2-4f06-8253-043101124ad0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.895494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.896105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.896383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.896694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] PATH_INFO: `/v3/projects/58702cf41e5145299c6a82b194d37ff2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.897782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] RBAC: Authorizing `identity:get_project(project_id=58702cf41e5145299c6a82b194d37ff2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.899213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f24d20-d25e-445e-bdeb-aa5af10ccff9 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.900946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 596/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/projects/58702cf41e5145299c6a82b194d37ff2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:00.906898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.993387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:01.002097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab9ff-eed9-4b48-8be2-64fa68b4f8ce None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:01.034578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:01.035173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:01.035454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:01.035729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:01.036442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=58702cf41e5145299c6a82b194d37ff2, user.id=f5fe95a7907644feb3e181b80c9ff401) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:01.036748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:01.038703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2efef-3e1d-49ea-8bec-886df1ad9d4a None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:01.044061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 589/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/role_assignments?user.id=f5fe95a7907644feb3e181b80c9ff401&scope.project.id=58702cf41e5145299c6a82b194d37ff2&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:02.908369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80f4a-d0f5-4187-8617-f40eae769c96 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:02.908854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80f4a-d0f5-4187-8617-f40eae769c96 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:02.909058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80f4a-d0f5-4187-8617-f40eae769c96 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:02.910226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 597/1186] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:02.915901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:02.916324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:02.916456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:02.934806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:02.935988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:03.000044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 590/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:03.279301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b80f4a-d0f5-4187-8617-f40eae769c96 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.298513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.377223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b80f4a-d0f5-4187-8617-f40eae769c96 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.409776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.410387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.410706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.410958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.420928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:03.425616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:03.426726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:39:03.427974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 598/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:03.432741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.513115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.528569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335331-d9c5-44c9-b711-fb0700db0ed1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.561548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.562090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.562373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.562678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.563340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:03.563641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.564994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:03.573258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 591/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:03.579058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.654726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.675051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c74ac-0fec-431b-9ed3-1558d14f2c70 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.708330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.709175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.709558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.709838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] PATH_INFO: `/v3/users/f5fe95a7907644feb3e181b80c9ff401` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.710967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5fe95a7907644feb3e181b80c9ff401)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.712376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:03.713917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 599/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:03 2022] GET /identity/v3/users/f5fe95a7907644feb3e181b80c9ff401 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:03.719617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.816330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448a09-c029-4f5e-91c9-7b0f6ca3e869 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.849524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.850146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.850429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.850735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] PATH_INFO: `/v3/projects/58702cf41e5145299c6a82b194d37ff2` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.851845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] RBAC: Authorizing `identity:get_project(project_id=58702cf41e5145299c6a82b194d37ff2)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.853256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470340c-ce21-421f-9124-8e45a10d4baf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:03.854888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 592/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:03 2022] GET /identity/v3/projects/58702cf41e5145299c6a82b194d37ff2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:03.860776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.957275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e37b3-f035-4e44-aae7-df588d9923a0 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.989291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.990567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.990854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.991123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] PATH_INFO: `/v3/projects/58702cf41e5145299c6a82b194d37ff2/users/f5fe95a7907644feb3e181b80c9ff401/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.992983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] RBAC: Authorizing `identity:create_grant(project_id=58702cf41e5145299c6a82b194d37ff2, user_id=f5fe95a7907644feb3e181b80c9ff401, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.994392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f1ce7-3e8f-4ce4-9f2d-426c0dd5224c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:04.069479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 600/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:39:03 2022] PUT /identity/v3/projects/58702cf41e5145299c6a82b194d37ff2/users/f5fe95a7907644feb3e181b80c9ff401/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:39:05.929178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a6dc-0551-4f26-9c7f-8b7fbd387ed9 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.929697 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a6dc-0551-4f26-9c7f-8b7fbd387ed9 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.929806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a6dc-0551-4f26-9c7f-8b7fbd387ed9 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.931121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 593/1193] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:05.936253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.936678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.936815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.949559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:05.955519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:05.956707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:06.021271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 601/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:39:06.293415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270a6dc-0551-4f26-9c7f-8b7fbd387ed9 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:06.311453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:06.395407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270a6dc-0551-4f26-9c7f-8b7fbd387ed9 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:06.429756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:06.430369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:06.430682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:06.430953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:06.440809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:06.445701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:06.446670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:39:06.447513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 594/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:06.452748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:06.547742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa4c86-2927-458f-b191-d00b685f08aa None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:06.580096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:06.580688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:06.580965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:06.581234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:06.581892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:06.582195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:06.583865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:06.586097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:06.592028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 602/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:06.597655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:06.672759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:06.696262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d728-89d1-45a9-b8c9-7d048d5662e3 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:06.730251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:06.730895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:06.731177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:06.731449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] PATH_INFO: `/v3/users/f5fe95a7907644feb3e181b80c9ff401` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:06.732556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] RBAC: Authorizing `identity:get_user(user_id=f5fe95a7907644feb3e181b80c9ff401)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:06.733980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:06.735552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 595/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:06 2022] GET /identity/v3/users/f5fe95a7907644feb3e181b80c9ff401 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:06.741521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:06.841392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763efec-b36a-4575-a9f5-7a8c4c7ef668 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:06.874260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:06.874886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:06.875170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:06.875444 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:06.937837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:06.941449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:06.943132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:07.038838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 603/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:07.044962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:07.140717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771809-5974-4eba-80c4-b37606b16a14 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:07.173481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:07.174090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:07.174372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:07.174677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] PATH_INFO: `/v3/projects/58702cf41e5145299c6a82b194d37ff2` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:07.175771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] RBAC: Authorizing `identity:get_project(project_id=58702cf41e5145299c6a82b194d37ff2)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:07.177214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930063b-bf8a-4545-8ad6-11572114e12b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:07.178922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 596/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:07 2022] GET /identity/v3/projects/58702cf41e5145299c6a82b194d37ff2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:07.184857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:07.278554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:07.282222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4ea5-7d1d-43d3-93d1-a896a60edf8d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:07.314930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:07.315522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:07.315800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:07.316070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:07.316789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=58702cf41e5145299c6a82b194d37ff2, user.id=f5fe95a7907644feb3e181b80c9ff401) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:07.317096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:07.319294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d654-0134-4402-aba1-c5209569e6bd None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:07.324985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 604/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:07 2022] GET /identity/v3/role_assignments?user.id=f5fe95a7907644feb3e181b80c9ff401&scope.project.id=58702cf41e5145299c6a82b194d37ff2&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:17.169521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:17.322472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=19 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:20.364764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfede-cb4b-414f-829b-c7f1963a2a24 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:20.365352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfede-cb4b-414f-829b-c7f1963a2a24 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:20.365352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfede-cb4b-414f-829b-c7f1963a2a24 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:20.366659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 597/1201] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:20.371831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:20.372253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:20.372379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:20.390768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:20.392830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:20.458621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 605/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:20.731577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfede-cb4b-414f-829b-c7f1963a2a24 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:20.832902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfede-cb4b-414f-829b-c7f1963a2a24 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:20.867203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:20.867941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:20.868225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:20.868494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:20.878795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:20.880217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:20.894582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:20.897122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:20.898354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:20.898354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:20.898354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:20.898354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 598/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:20.902434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:20.998378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0182fb-e6e0-4790-a564-88e71ace4483 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:21.026722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:21.032371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:21.033015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:21.033334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:21.033879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:21.034551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:21.036373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:21.036373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96b22-aa8e-4631-b751-800727e9a46e None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:21.046771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 606/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:21.053453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:21.105771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:21.152050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2a34-994d-4c50-908c-db1e61126837 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:21.185983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:21.186606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:21.186888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:21.187158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:21.187800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:21.189667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d91db-e69f-407c-bee4-27b8d9f40689 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:21.277753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 599/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 30 14:40:21 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:40:23.197542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee3f2-19d5-4c4c-867b-d452945ad868 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:23.198052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee3f2-19d5-4c4c-867b-d452945ad868 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:23.198052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee3f2-19d5-4c4c-867b-d452945ad868 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:23.199413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 607/1206] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:23.204481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:23.204924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:23.205026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:23.222911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:23.224100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:23.290034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 600/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:23.560837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee3f2-19d5-4c4c-867b-d452945ad868 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:23.662728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee3f2-19d5-4c4c-867b-d452945ad868 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:23.695809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:23.696568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:23.696890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:23.697160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:23.707915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:23.712714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:23.713816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:23.714816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 608/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:23.720256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:23.759009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:23.817940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c4e5-cf53-4074-98e5-e2e9a8e506f4 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:23.852992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:23.853819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:23.854096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:23.854367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:23.855070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:23.855368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:23.856714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:23.864517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 601/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:23.870274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:23.922704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:23.971356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e53c-dffd-4af2-8b1c-df292d28eab8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.005206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.005829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.006108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.006379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.016482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.018127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:24.032217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:24.033586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:24.035490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:24.035490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:24.035490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:24.035490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 609/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:24.040895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:24.138816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:24.141538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87caedc-dbb2-4353-a8ae-95177531facd None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.174369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.175046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.175499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.175780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.176422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:24.176729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.178102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.188915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 602/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:24.195297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:24.294833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782cb86-10fc-4bb6-a588-053d68f5fcdb None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.296331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:24.328478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.329103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.329387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.329662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.337436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.341553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:24.349878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:24.351081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:24.352286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 610/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:24.356899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:24.455504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fabe61-c5c5-4256-9671-67d34cc78222 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.488783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.489378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.489656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.489925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.490680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:24.490988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.492397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.509327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 603/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:24.515123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:24.613490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96140f7-7808-49bd-9a46-dea3e8d8f1a8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.646990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.647600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.647887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.648163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.677846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:24.714538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.715917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.813617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 611/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:24.820267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:24.839524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:24.917382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a08e1b-2231-4c97-b406-07463713b8d8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:24.954117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:24.954782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:24.955067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:24.955340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:24.965408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:24.966891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:24.981729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:24.999297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:25.000419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:25.000419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:25.000419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:25.000419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 604/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:25.000694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:25.047992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:25.085500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9344-3c9c-4fc9-8b56-3565d1e2be9b None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:25.119620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:25.120407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:25.120856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:25.121167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:25.122249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:25.122585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:25.124029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:25.135456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 612/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:25.141159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:25.210397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:25.240269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff26bdf-a8e6-4587-8adb-d63ad9e81ce8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:25.271615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:25.273517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:25.273517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:25.273517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:25.279346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:25.280764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:25.292814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:25.293961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:25.295092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 605/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:25.300094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:25.398097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5ee8-b1bf-4c7a-b6eb-b0bdfc009313 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:25.420349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:25.431554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:25.432161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:25.432445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:25.432720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:25.433413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:25.433719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:25.435168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd06d3-84f5-4bc1-8c9f-62ce93a58024 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:25.446804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 613/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:25.453070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:25.554168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de730abe-fe31-4dea-8bd2-44f57182775e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:25.583899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:25.589605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:25.590206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:25.590510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:25.590807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:25.591525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:25.591832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:25.593236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f18db5-2ea4-4356-be9c-489efd8ab02b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:25.599560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 606/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:40:25 2022] GET /identity/v3/role_assignments?user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:27.469809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47f12-340b-470c-9ec4-132480d5b0ed None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:27.470366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47f12-340b-470c-9ec4-132480d5b0ed None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:27.470366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47f12-340b-470c-9ec4-132480d5b0ed None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:27.471729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 614/1220] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:27.476979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:27.477356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:27.477519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:27.496602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:27.498614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:27.564428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 607/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:40:27.836137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e47f12-340b-470c-9ec4-132480d5b0ed None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:27.937816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e47f12-340b-470c-9ec4-132480d5b0ed None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:27.971031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:27.972283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:27.972689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:27.972974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:27.983078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:27.988560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:27.989685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:27.990955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 615/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:27.995651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.094147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d2ad6-8bdf-4e56-8701-42d4368fdabc None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.117754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:28.128190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.128790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.129068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.129338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.129991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] RBAC: Adding query filter params (name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:28.130291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.131675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.139207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 608/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:28.145265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.190156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:28.244577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fc72-7ae5-49c0-85e1-3d96d181a819 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.277062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.277682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.277961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.278234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.292418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.293849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:28.308361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:28.309519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:28.310496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:28.310496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:28.310496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:28.310496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 616/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:28.315249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.416745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4719ba8-8e64-423e-9d8f-a01ce343d51b None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.450346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.451012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.451297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.451566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.452200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:28.452501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.453847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.466187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 609/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:28.472865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.566025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:28.572676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f599f6-8d0f-4ba1-9876-76a2047e7b53 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.609729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.610356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.610669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.610943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.618815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.620249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:28.632056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:28.638101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:28.639313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 617/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:28.640053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.686409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:28.738821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2cbef-4d83-4252-b727-49b95384dbee None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.772738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.773383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.773770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.774102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.774854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:28.775158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.776708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.793938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 610/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:28.800046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:28.902129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e98ea-a5a1-4245-a0ad-93920a35f05a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:28.935500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:28.936589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:28.936589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:28.936778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:28.947882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:28.949431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:28.964205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:28.968063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:28.969235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:28.969235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:28.969235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:28.969235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 618/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:40:28.971347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:29.069713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b80de-e83e-4462-ac9e-9c98ba3790a4 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:29.072044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:29.102641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:29.103269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:29.103552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:29.103827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:29.104469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:29.104772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:29.106122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:29.117465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 611/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:29.127031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:29.137765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:29.227244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa606a-73ab-44b2-b5fa-79da9d38d926 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:29.260617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:29.261245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:29.261529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:29.261832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:29.268448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:29.269941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:29.280964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:29.285612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:29.286776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 619/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:29.288304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:29.386352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91e92-2820-40ae-a6f8-2da61a3941f2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:29.419236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:29.422345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:29.422345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:29.422345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:29.422345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:29.422345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:29.422836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a5bf-7c1c-4634-8041-29714c510bc0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:29.436025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 612/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:29.442258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:29.506894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:29.541475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33bd2-f0ea-4a6f-ace5-6170a0a86b4d None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:29.579173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:29.579830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:29.580113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:29.580389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/0b8ff6d1bfd44ec08cef4f0039e1aedc/roles/328893edd99d4e4481d51f18b861953f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:29.595415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=0b8ff6d1bfd44ec08cef4f0039e1aedc, role_id=328893edd99d4e4481d51f18b861953f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:29.599030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e32e-aafa-4868-b25f-8e0d28b64ef6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:29.685613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 620/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:40:29 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/0b8ff6d1bfd44ec08cef4f0039e1aedc/roles/328893edd99d4e4481d51f18b861953f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:40:31.600346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895c0-7127-4499-8e31-0b081fed6603 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:31.600949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895c0-7127-4499-8e31-0b081fed6603 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:31.600949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895c0-7127-4499-8e31-0b081fed6603 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:31.602432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 613/1233] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:31.607838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:31.608274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:31.615815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:31.626950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:31.628856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:31.693764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 621/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:40:31.959571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185895c0-7127-4499-8e31-0b081fed6603 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:31.983776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:32.059485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185895c0-7127-4499-8e31-0b081fed6603 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.093828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.095094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.095372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.095644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.106144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:32.111070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:32.112862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:32.113719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 614/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 30 14:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:32.119285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:32.165921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:32.216908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b7f2-4785-4022-818b-be9e469f87c2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.248968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.249564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.249845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.250118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.250809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] RBAC: Adding query filter params (name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:32.251113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:32.253229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:32.261923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 622/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:32.267844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:32.353701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:32.370155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8529a-8830-4c7c-b334-3a631d163f89 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.404383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.405015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.405300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.405576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.417551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:32.419059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:32.433893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:32.435071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:32.436206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:32.436206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:32.436206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:32.436206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 615/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:40:32.441374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:32.540917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db2cb-d935-4872-9759-17faf9fd5111 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.550121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:32.574421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.575072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.575358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.575631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.576269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:32.576574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:32.577936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:32.589877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 623/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:32.596249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:32.696707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839c97-4be6-46f5-8036-aecaf6be6985 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.729943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.730598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.730883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.731155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] PATH_INFO: `/v3/users/placement` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.733814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:32.739335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:32.740771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:32.751667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:32.752832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:32.754032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 616/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:32.758934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:32.857443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049601-abd3-40b4-8ec3-76b4017c77d7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:32.889785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:32.890392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:32.890698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:32.890971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:32.891700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:32.892006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:32.894027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:32.911538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 624/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:32.917430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.016397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19059-a50f-4ffd-9754-46ad2f7bdddf None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.049898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.050522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.050808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.051083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.111053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:33.117716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.119254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:33.215680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 617/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:40:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:33.221595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.248294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:33.319734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f22170-b676-4fda-952a-06a9d0fe281a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.356240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.357235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.357709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.358172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.370504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.371984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:33.387585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:33.391712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:33.393480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:33.393480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:33.393480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:33.393480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 625/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:33.395338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.485088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:33.490956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3793a-0bdf-46f6-871f-f50d79a5a1a7 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.523249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.523844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.524121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.524389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.525014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:33.525311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.526717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:33.537565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 618/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:33.543321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.621050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:33.642657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e99ac-705d-48a8-98bc-fca1d10e3b8c None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.675481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.676104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.676384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.676653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.683313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.684754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:33.696626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:33.697660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:33.698774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 626/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:33.704480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.802919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a38a08-6c7f-47d9-8e58-bd15fd71014e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.838145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.838868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.839205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.839479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.840231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:33.840583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.842012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a8b68-5f47-4673-901f-6c5993a6dc0f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:33.854833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 619/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:33.860900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:33.958960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa4ad-04bb-473f-af09-6b3c202debef None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:33.992051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:33.992654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:33.992936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:33.993210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:33.993936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] RBAC: Adding query filter params (role.id=328893edd99d4e4481d51f18b861953f, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:33.994247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:33.995744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55be26-585c-4dba-8ea1-bb2649c80bfc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:34.001315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 627/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:40:33 2022] GET /identity/v3/role_assignments?user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=328893edd99d4e4481d51f18b861953f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:35.930006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d762-a25f-4f22-8676-42c75d572440 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:35.930546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d762-a25f-4f22-8676-42c75d572440 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:35.930633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d762-a25f-4f22-8676-42c75d572440 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:35.931881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 620/1247] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:35.937113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:35.937535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:35.937652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:35.944514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:35.956566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:35.957748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:36.023575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 628/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:36.292786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d762-a25f-4f22-8676-42c75d572440 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:36.310796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:36.394435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d762-a25f-4f22-8676-42c75d572440 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:36.427503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:36.428122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:36.428405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:36.428679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:36.438427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:36.443731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:36.447940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:36.448803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 621/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:36.450993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:36.550187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e05f5-a14d-49d5-beaf-0f81eb1e8887 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:36.579080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:36.584412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:36.585021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:36.585306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:36.585583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:36.586251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:36.586594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:36.587958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:36.595961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 629/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:36.601793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:36.679537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:36.701883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1521c9-db1b-4081-953c-08372256f58e None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:36.735721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:36.736845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:36.737128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:36.737440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:36.747186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:36.748664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:36.763631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:36.766343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:36.767551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:36.767551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:36.767551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:36.767551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 622/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:36.770900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:36.871802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373bd4b-558b-43fe-9481-50a06a96b0c6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:36.903932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:36.904538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:36.904826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:36.905103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:36.905751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:36.906061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:36.908371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:36.920720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 630/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:36.927104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.026771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977ccc-1197-4be2-a977-54f143a19e6f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:37.053681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:37.061518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:37.062182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:37.062471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:37.062756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:37.070216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:37.071694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:37.083570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:37.084559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:37.085595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 623/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:37.089835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.144923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:37.188927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd717a5-847f-43d2-83be-443f94bdf6df None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:37.223136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:37.223739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:37.224022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:37.224296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:37.225023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:37.225350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:37.226777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:37.243114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 631/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:37.249048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.347268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7b7fb-2b7a-49aa-9282-3578208a9b65 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:37.379953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:37.380597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:37.380877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:37.381148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:37.435943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:37.447843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:37.449284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:37.545112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 624/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:40:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:37.551349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.654206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ebd4e-a320-4940-bdf0-3071e4199f05 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:37.667635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:37.687868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:37.688513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:37.688798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:37.689564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:37.699148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:37.700588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:37.715783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:37.716945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:37.718053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:37.718053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:37.718053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:37.718053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 632/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:37.722795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.806710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:37.819402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274132-20db-4e50-9221-26eb8d33ae83 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:37.853330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:37.853943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:37.854226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:37.854538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:37.855179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:37.855484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:37.856840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:37.867596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 625/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:37.873321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:37.971828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f573f-f377-453e-865a-607bd22a2636 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:38.004977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:38.005597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:38.005875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:38.006145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:38.012534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:38.013958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:38.024847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:38.025930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:38.027269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 633/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:38.031835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:38.131235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3224b-5b85-4dca-bfc6-422fa049aaa8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:38.163977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:38.164586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:38.164870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:38.165143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:38.165832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:38.166140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:38.167594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb21bec-b58d-4436-9ed2-11278b10b7db None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:38.179823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 626/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:38.186077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:38.211819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:38.283474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8f58-3e6c-4b16-9195-9d8a5258879a None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:38.316806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:38.317405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:38.317691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:38.317964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:38.318716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:38.319025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:38.320434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3422148-6579-4c8f-b13e-12d99cc9ea5c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:38.325740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 634/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:40:38 2022] GET /identity/v3/role_assignments?user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:40.259937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903780a5-3918-41f7-8830-4223356f90b7 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:40.260864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903780a5-3918-41f7-8830-4223356f90b7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:40.260864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903780a5-3918-41f7-8830-4223356f90b7 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:40.261931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 627/1261] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:40.267695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:40.268092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:40.268247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:40.287518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:40.288689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:40.355895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 635/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:40.626710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903780a5-3918-41f7-8830-4223356f90b7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:40.637572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:40.728835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903780a5-3918-41f7-8830-4223356f90b7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:40.762182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:40.762828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:40.763108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:40.763401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:40.775221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:40.780024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:40.783980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:40.785025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 628/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:40.787462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:40.806133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:40.885270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1173f-e029-4fcc-b8e8-f6f551d594b3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:40.917927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:40.918552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:40.918834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:40.919106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:40.919880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:40.920183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:40.921563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:40.929338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 636/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:40.935137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.008781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:41.040824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d184d-a34a-4b00-8850-f3cbbfcb96a0 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.075140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.075764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.076038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.076304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.085841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.087407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:41.101911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:41.103186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:41.104169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:41.104169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:41.104169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:41.104169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 629/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:40:41.108976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.190164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:41.207999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd979ef-5f5f-487d-b6f3-9c2d2e8cb4b8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.239995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.240592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.240872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.241142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.241777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:41.242077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.243456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.255221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 637/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:41.261024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.360460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d6c8-2388-46fb-9a15-13bf4c1eaac2 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.379727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:41.393906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.394576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.394865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.395143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.402464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.403903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:41.415608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:41.416778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:41.418061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 630/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:41.422809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.520784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab36-2afc-4b43-acff-b3a11703a974 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.556468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.557082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.557365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.557639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.558472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:41.558780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.560197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.569539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:41.577886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 638/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:41.584468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.683099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019a06-8c12-4e7f-babd-505b3c2cac65 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.716343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.716978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.717258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.717537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.728660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.730104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:41.744610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:41.748942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:41.750114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:41.750114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:41.750114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:41.750114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 631/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:41.752681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.852361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e39b-b206-43e8-a3a4-180351bfa4be None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:41.886556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:41.887163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:41.887447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:41.887721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:41.888392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:41.888696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:41.890063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:41.901575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 639/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:41.907868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:41.940096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:42.006142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03380f-dbf4-41d8-a089-86916e347a7f None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:42.039759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:42.040380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:42.040662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:42.040934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:42.047303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:42.049331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:42.060570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:42.061635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:42.062641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 632/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:40:42.068167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:42.127101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:42.167093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725bc53-372d-47d6-aac1-f7a441cc9696 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:42.198873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:42.199486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:42.199769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:42.200039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:42.200735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:42.201043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:42.202479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49199-282d-4388-954b-60dd0c518c9c None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:42.214250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 640/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:42.220977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:42.310538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:42.318950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef5883-eb7d-40d0-af42-029bf6d22a4d None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:42.351522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:42.352174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:42.352478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:42.352731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] PATH_INFO: `/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/0b8ff6d1bfd44ec08cef4f0039e1aedc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:42.354640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4c34a5e4054ee4a2819fab0f36a234, user_id=0b8ff6d1bfd44ec08cef4f0039e1aedc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:42.356067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc539-f52e-4424-80db-2ae83a45f2ee None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:42.469163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 633/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 30 14:40:42 2022] PUT /identity/v3/projects/7a4c34a5e4054ee4a2819fab0f36a234/users/0b8ff6d1bfd44ec08cef4f0039e1aedc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:40:44.351801 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8247-fd74-4b38-bb6d-988f3921f2fa None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:44.352325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8247-fd74-4b38-bb6d-988f3921f2fa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:44.352417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8247-fd74-4b38-bb6d-988f3921f2fa None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:44.353686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 641/1274] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:44.358961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:44.359375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:44.359574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:44.378404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:44.379608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:44.444053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 634/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:44.714292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c8247-fd74-4b38-bb6d-988f3921f2fa None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:44.814041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c8247-fd74-4b38-bb6d-988f3921f2fa None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:44.832621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:44.849735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:44.850362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:44.850666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:44.850936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:44.860736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:44.865574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:44.866748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:44.867626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 642/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 30 14:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:44.872652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:44.952470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:44.971085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb702d05-6bf6-40b2-babe-1f7ee02727bd None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.002866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ac59-4721-4bed-b454-974261743013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.003470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ac59-4721-4bed-b454-974261743013 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.003754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ac59-4721-4bed-b454-974261743013 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.004026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ac59-4721-4bed-b454-974261743013 None admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.004685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ac59-4721-4bed-b454-974261743013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:45.004990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ac59-4721-4bed-b454-974261743013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.006344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ac59-4721-4bed-b454-974261743013 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.014040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 635/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 30 14:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:45.020416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:45.120148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e552-b307-4ec2-9755-adb345b66708 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.153297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.153915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.154198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.154494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.164586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.166231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:45.180101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:45.181173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:45.182115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:45.182115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:45.182115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:45.182115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 643/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:45.187123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ac59-4721-4bed-b454-974261743013 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:45.286751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ac59-4721-4bed-b454-974261743013 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.319581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.320192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.320472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.320742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.321380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:45.321683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.323075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.335738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 636/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:45.341526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:45.371924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:45.440473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f2f70-b093-4e62-a0fa-489101898cf7 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.474638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.475305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.475588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.475860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.483217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.484637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:45.496129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:45.497100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:45.498291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 644/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:45.504136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:45.507933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:45.602016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e2023-3591-4f32-98da-b7d20df68528 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.635841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.636444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.636726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.636995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.637722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:45.638024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.639566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.656513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 637/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:45.662399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:45.752635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:45.761688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae253-87a7-4800-aa33-3cb3378ec0f8 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:45.793458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:45.794053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:45.794330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:45.794629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:45.861357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:45.862852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:45.948063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:45.958383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 645/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:45.964302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:46.026416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:46.064595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a04a-f7a6-4841-a43c-211a30719ca8 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:46.098468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:46.099093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:46.099378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:46.099669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:46.109593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:46.112177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:46.127014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:46.127961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:46.128891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:46.128891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:46.128891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:46.128891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 638/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:46.135132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:46.234238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533418-971b-4585-8aab-be7923b7d294 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:46.267644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:46.268245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:46.268528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:46.268800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:46.269437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:46.269741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:46.271129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:46.283320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 646/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:46.289028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:46.386881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4556d-b443-4425-8724-40b813d0d7f5 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:46.400256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:46.419725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:46.420352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:46.420628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:46.420898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:46.427438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:46.428878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:46.440724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:46.441805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: ERROR keystone.server.flask.application Aug 30 14:40:46.442794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 639/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:46.447847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:46.497222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:46.545442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6c7a-5dbe-4558-b106-dd421a98bef6 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:46.577215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:46.577816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:46.578103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:46.578377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:46.579617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:46.579925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:46.581348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1a9e-2a18-41e2-91a1-5c0bdf1d8c66 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:46.595265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 647/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:46.601319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:46.703384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbd096-ec31-4ee0-a003-c12391100c98 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:46.739794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:46.740404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:46.740686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:46.740953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:46.741687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] RBAC: Adding query filter params (role.id=ce01c317402a4f3f8390b3b25aec6ea8, scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234, user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:46.741993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:46.743499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed458f5-4155-4acb-bbb1-6e0c95eaf8cd None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:46.759167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 640/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 30 14:40:46 2022] GET /identity/v3/role_assignments?user.id=0b8ff6d1bfd44ec08cef4f0039e1aedc&scope.project.id=7a4c34a5e4054ee4a2819fab0f36a234&role.id=ce01c317402a4f3f8390b3b25aec6ea8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:48.677714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b435ab-1255-4b4a-be50-043539b3a60d None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:48.678241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b435ab-1255-4b4a-be50-043539b3a60d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:48.678241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b435ab-1255-4b4a-be50-043539b3a60d None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:48.679601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 648/1288] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:48.684645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:48.691354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:48.691354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:48.703226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:48.704901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:48.734640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:48.771390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 641/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:49.039971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b435ab-1255-4b4a-be50-043539b3a60d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.140454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b435ab-1255-4b4a-be50-043539b3a60d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.151579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:49.174127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.174826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.175111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.175393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.175979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.177334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:49.186111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:49.187443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:49.189043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 649/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:40:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:49.193987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.290475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a12b3-2122-424c-8150-37e00f74224b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.324022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.324643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.324936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.325210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.325834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:49.326138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.327532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fb0c-e8c2-412c-be19-3fd77392a0f0 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.332473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 642/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 30 14:40:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:49.338407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.436797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc480d-8e73-4904-a13d-0377bffae07f None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.469672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.470268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.470579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.470859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] PATH_INFO: `/v3/services` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.471489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:49.471795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.473147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351c23-4c71-4367-b06b-07a2695f69b1 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.477534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 650/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 30 14:40:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:51.423440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13181f-c96d-4666-93f6-93a9b8ab5ef6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.424018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13181f-c96d-4666-93f6-93a9b8ab5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.424018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13181f-c96d-4666-93f6-93a9b8ab5ef6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.425339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 643/1293] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:51.430550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9738cc-8c47-4456-9f15-f20f4a1818c7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.430947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9738cc-8c47-4456-9f15-f20f4a1818c7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.431115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9738cc-8c47-4456-9f15-f20f4a1818c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.449119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ab9738cc-8c47-4456-9f15-f20f4a1818c7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:51.450299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ab9738cc-8c47-4456-9f15-f20f4a1818c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:51.480024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:51.515374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 651/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:51.785172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13181f-c96d-4666-93f6-93a9b8ab5ef6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:51.816353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:51.886358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13181f-c96d-4666-93f6-93a9b8ab5ef6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:51.920225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:51.920833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.921122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.921393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.922351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:51.923470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd164-91ed-4f94-938c-518d2bdf690c None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.051817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 644/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 30 14:40:51 2022] POST /identity/v3/services => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:40:53.969110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425342-33f9-4ba8-aeb8-7973bf6dc1ee None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.969622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425342-33f9-4ba8-aeb8-7973bf6dc1ee None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.969736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425342-33f9-4ba8-aeb8-7973bf6dc1ee None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.971066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 652/1296] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:53.976271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.976673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.976815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.994957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:53.996120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:54.067949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 645/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:54.336850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d425342-33f9-4ba8-aeb8-7973bf6dc1ee None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:54.437131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d425342-33f9-4ba8-aeb8-7973bf6dc1ee None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:54.470855 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:54.471485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:54.471765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:54.472036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:54.472611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:54.474090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:54.482805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:54.488532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:54.489541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 653/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:40:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:54.490375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:54.508000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:54.587205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d375dd3-c29a-43be-b141-3914bfc981e2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:54.622143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:54.622783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:54.623065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:54.623334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:54.623957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:54.624256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:54.626249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:54.631254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 646/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 30 14:40:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:54.637316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:54.669504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:54.735665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621e9a-4153-44c5-b70f-968058d29032 None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:54.768914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:54.769511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:54.769791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:54.770082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:54.770785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] RBAC: Adding query filter params (interface=public, service_id=277b0d3b2b2247dda4446d5d7ff1ee8b, region_id=RegionOne) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:54.771091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:54.772433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391fb2-b869-4910-8272-a7c2cc7879b7 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:54.777313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 654/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 30 14:40:54 2022] GET /identity/v3/endpoints?service_id=277b0d3b2b2247dda4446d5d7ff1ee8b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:54.784178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:54.864790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:54.882523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bf44-cfe9-437f-8001-f00b16ded350 None admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:54.914884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:54.915535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:54.915816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:54.916085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:54.916681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:54.918029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe5fed-8ae2-4fbb-bb2d-a3566e090e38 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:54.924665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 647/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 30 14:40:54 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:40:56.848051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604445-13d2-42d7-a084-76e8e2361d7c None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.848543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604445-13d2-42d7-a084-76e8e2361d7c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.848652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604445-13d2-42d7-a084-76e8e2361d7c None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.850108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 655/1302] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:56.855213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.855590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.855764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.874052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:56.875841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:56.942614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 648/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:57.215416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604445-13d2-42d7-a084-76e8e2361d7c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.309094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:57.316829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604445-13d2-42d7-a084-76e8e2361d7c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.350900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9769-8404-4367-b826-03bff951debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.351526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9769-8404-4367-b826-03bff951debc None admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.351812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9769-8404-4367-b826-03bff951debc None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.352180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9769-8404-4367-b826-03bff951debc None admin] PATH_INFO: `/v3/services/placement` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.352773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c9769-8404-4367-b826-03bff951debc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.354133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c9769-8404-4367-b826-03bff951debc None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application [None req-101c9769-8404-4367-b826-03bff951debc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:57.362988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:57.364364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: ERROR keystone.server.flask.application Aug 30 14:40:57.365517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 656/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:57.370126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.446754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:57.469696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef8bde-fa8d-443d-a817-3a22230640d1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.503897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.504528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.504818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.505091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] PATH_INFO: `/v3/services` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.505712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:57.506013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.507414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b30e9-f95f-4bfe-9674-88e9c3baaf09 None admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.512321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 649/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:57.518129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9769-8404-4367-b826-03bff951debc None admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.614987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9769-8404-4367-b826-03bff951debc None admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.646946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.647543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.647822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.648094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.648750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.650129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea068-9cd4-48f7-b305-c9fcfaf01885 None admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.743421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 657/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:40:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:41:07.509397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=30 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:07.738595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:32.686209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86c7a-16fc-44c1-9eb6-d0d5fc1274a8 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:32.686738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86c7a-16fc-44c1-9eb6-d0d5fc1274a8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:32.686846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86c7a-16fc-44c1-9eb6-d0d5fc1274a8 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:32.688521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 650/1307] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:32.694259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116539-1471-4ce6-8aa5-41050f5055d5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:32.694717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116539-1471-4ce6-8aa5-41050f5055d5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:32.695026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116539-1471-4ce6-8aa5-41050f5055d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:32.794936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-96116539-1471-4ce6-8aa5-41050f5055d5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:32.796214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-96116539-1471-4ce6-8aa5-41050f5055d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:32.938856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 658/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:33.235976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.236257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.236790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.238211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 651/1309] 10.222.0.47 () {54 vars in 965 bytes} [Tue Aug 30 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:33.244997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543695-5418-4770-8932-c19e90d3821e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.245306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543695-5418-4770-8932-c19e90d3821e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.245692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543695-5418-4770-8932-c19e90d3821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.338009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9a543695-5418-4770-8932-c19e90d3821e None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:33.339441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9a543695-5418-4770-8932-c19e90d3821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.365782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:33.433607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 659/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Aug 30 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:33.444966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:33.444966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.579185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2db4-d6dd-4529-a7bf-fffdd3e809cd None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:33.677867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:33.678575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.678803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.679075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.681614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.741248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:33.801158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:33.802628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112bdc5-1697-4648-8806-6a86a126f9ec service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:33.825401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 652/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:36.073051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751886-d1ad-4080-86b6-cd4daf324775 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.073581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751886-d1ad-4080-86b6-cd4daf324775 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.073581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751886-d1ad-4080-86b6-cd4daf324775 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.075308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 660/1312] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:36.081078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc407ac-969c-4a8d-9dee-709f74c8fc93 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.081517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc407ac-969c-4a8d-9dee-709f74c8fc93 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.081616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc407ac-969c-4a8d-9dee-709f74c8fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.179452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4dc407ac-969c-4a8d-9dee-709f74c8fc93 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:36.181325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4dc407ac-969c-4a8d-9dee-709f74c8fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.288241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 653/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:36.585663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.586051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.586423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.587897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 661/1314] 10.222.0.47 () {54 vars in 965 bytes} [Tue Aug 30 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:36.593842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9119-62be-4fda-a734-9ab2d3f6044e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.594206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9119-62be-4fda-a734-9ab2d3f6044e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.594636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9119-62be-4fda-a734-9ab2d3f6044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.607599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.677340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c54a9119-62be-4fda-a734-9ab2d3f6044e None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:36.678605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c54a9119-62be-4fda-a734-9ab2d3f6044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.756803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 654/1315] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Aug 30 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:47:36.766063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:36.767763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.881893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e3e5-75d9-477f-ac74-60e5be9e55cd None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:36.966326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.969207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:36.969833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.970118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.970395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.972108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:37.095343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:37.096778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e0ed9-3eff-416c-8a63-e2dfdc849b33 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:37.115923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 662/1316] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:39.903905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431568-590b-45f3-ad5d-33b177778618 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:39.904497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431568-590b-45f3-ad5d-33b177778618 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:39.904497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431568-590b-45f3-ad5d-33b177778618 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:39.906023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 655/1317] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:39.911508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6387-0161-40be-9ca0-95ea0c41c3e6 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:39.911944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6387-0161-40be-9ca0-95ea0c41c3e6 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:39.912069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6387-0161-40be-9ca0-95ea0c41c3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:39.985393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-274b6387-0161-40be-9ca0-95ea0c41c3e6 None None] MFA Rules not processed for user `3d538553d7de4705bdde974f0e9254ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:39.986748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-274b6387-0161-40be-9ca0-95ea0c41c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:40.048220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:40.097742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 663/1318] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:40.389959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431568-590b-45f3-ad5d-33b177778618 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:40.391559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-32431568-590b-45f3-ad5d-33b177778618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:40.505885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431568-590b-45f3-ad5d-33b177778618 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:40.509554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:40.589348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:40.589996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:40.590279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:40.590581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:40.592269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:40.718164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:40.719651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207384ef-f10d-4be7-b038-af1d963da67c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:40.741181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 656/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:43.701505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.702051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.702051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.703458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 664/1320] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:43.708785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1d52-e791-4e25-9863-10651c81e870 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.709218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1d52-e791-4e25-9863-10651c81e870 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.709322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1d52-e791-4e25-9863-10651c81e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.751114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:43.776896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ba8c1d52-e791-4e25-9863-10651c81e870 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:43.778128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ba8c1d52-e791-4e25-9863-10651c81e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:43.878303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 657/1321] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:44.168539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:44.170077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:44.274140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae46f8-4822-40f6-9fb6-bbf024bf3641 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:44.347165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:44.347776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:44.348057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:44.348330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:44.349931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:44.357545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:44.463995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:44.465319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd59268-7129-444a-bebf-313b61b19579 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:44.483507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 665/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:47.528501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:47.529042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:47.529042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:47.530716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 658/1323] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:47.536152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e188f-97c2-41dd-9936-3f416d09b52a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:47.536699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e188f-97c2-41dd-9936-3f416d09b52a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:47.537236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e188f-97c2-41dd-9936-3f416d09b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:47.607168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b25e188f-97c2-41dd-9936-3f416d09b52a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:47.608390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b25e188f-97c2-41dd-9936-3f416d09b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:47.669441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:47.709363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 666/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:48.000564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:48.002119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:48.121505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454a6f-e36c-4a6d-a2cc-92e0812f1990 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:48.135188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:48.197428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:48.198039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:48.198356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:48.198763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:48.200385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:48.310376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:48.311991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43edb2b-aab1-4c37-bc8d-e75ab6f4dd86 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:48.330095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 659/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:50.365438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:50.366000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:50.366000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:50.368138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 667/1326] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:50.373547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c05f5-5f76-4663-8165-47742a7d17e5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:50.374007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c05f5-5f76-4663-8165-47742a7d17e5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:50.374103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c05f5-5f76-4663-8165-47742a7d17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:50.424637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:50.443261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d51c05f5-5f76-4663-8165-47742a7d17e5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:50.444540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d51c05f5-5f76-4663-8165-47742a7d17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:50.547640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 660/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:50.844315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:50.845886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:50.954350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403605d-d5cd-4535-9749-2e93a8244e85 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:51.030151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:51.030710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:51.030999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:51.031270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:51.032928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:51.060074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:51.158931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:51.160378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46be4-56c8-4752-a06e-a39e397dd567 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:51.179892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 668/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:53.212277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:53.212792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:53.212792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:53.214308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 661/1329] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:53.219878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416806f4-201d-4a95-abba-477a7db3e41f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:53.220350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416806f4-201d-4a95-abba-477a7db3e41f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:53.220468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416806f4-201d-4a95-abba-477a7db3e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:53.293338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-416806f4-201d-4a95-abba-477a7db3e41f None None] MFA Rules not processed for user `3d538553d7de4705bdde974f0e9254ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:53.294592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-416806f4-201d-4a95-abba-477a7db3e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:53.363761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:53.396351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 669/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:53.690146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:53.691753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:53.833446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede5625-2b6c-4a22-8812-864a7309c276 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:53.857135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:53.912055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:53.912665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:53.912944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:53.913400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:53.915418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:54.025461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:54.026967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95778-6146-4f95-b5f1-d216c526062f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:54.045243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 662/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:56.591591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:56.592255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:56.592255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:56.593525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 670/1332] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:56.598860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9aec3-d21f-4ab5-9813-3f4c1af46f0a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:56.599303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9aec3-d21f-4ab5-9813-3f4c1af46f0a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:56.599408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9aec3-d21f-4ab5-9813-3f4c1af46f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:56.664638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:56.667427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-31c9aec3-d21f-4ab5-9813-3f4c1af46f0a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:56.668650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-31c9aec3-d21f-4ab5-9813-3f4c1af46f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:56.765169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 663/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:57.049191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:57.050781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:57.157864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc089d2-6d31-49d5-a15b-1e0deaf70e59 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:57.231264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:57.231880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:57.232164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:57.232439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:57.234108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:57.263933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:57.353261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:57.354656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f119f1-865e-4998-a22e-3d684f892844 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:57.374138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 671/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:59.381310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:59.381950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:59.382111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:59.383750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 664/1335] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:47:59.389332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1d4e-6a51-4706-9c68-6f4a1f0f2b99 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:59.389839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1d4e-6a51-4706-9c68-6f4a1f0f2b99 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:59.389933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1d4e-6a51-4706-9c68-6f4a1f0f2b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:59.458624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-469c1d4e-6a51-4706-9c68-6f4a1f0f2b99 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:59.460418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-469c1d4e-6a51-4706-9c68-6f4a1f0f2b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:59.539637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:59.563835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 672/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:47:59.850342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:59.852076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:59.965076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f06ec-d9f3-4e37-a87b-ccf29c1670f6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:59.995046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:00.044005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:00.044622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:00.044928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:00.045203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:00.046868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:00.159932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:00.161307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d5b0e-dc23-48ce-86cc-e10a65eee8e3 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:00.180351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 665/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:02.830646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:02.830646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:02.831087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:02.832080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 673/1338] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:02.838161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce917-02e6-4f16-b89a-a18789609f18 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:02.838621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce917-02e6-4f16-b89a-a18789609f18 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:02.838727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce917-02e6-4f16-b89a-a18789609f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:02.903492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-19dce917-02e6-4f16-b89a-a18789609f18 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:02.904959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-19dce917-02e6-4f16-b89a-a18789609f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:02.914097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:03.002528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 666/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:03.284959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:03.286512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:03.389169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679679b-2430-479d-a4d5-ff1bf3f1967a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:03.461836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:03.462435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:03.462741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:03.463013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:03.464637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:03.499508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:03.572587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:03.573929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90501c-1918-4d81-b6a4-df16def05afe service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:03.592832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 674/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:07.824479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:07.825032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:07.825032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:07.826598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 667/1341] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:07.831827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ea95-a659-490c-8229-7f3d13caac1d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:07.832209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ea95-a659-490c-8229-7f3d13caac1d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:07.832380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ea95-a659-490c-8229-7f3d13caac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:07.900467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-94e2ea95-a659-490c-8229-7f3d13caac1d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:07.901624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-94e2ea95-a659-490c-8229-7f3d13caac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:07.991282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:08.003030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 675/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:08.288426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:08.289947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.393875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01bc04-de46-48b9-ad40-2f3fb58c4653 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:08.433260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:08.471349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:08.471894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:08.472220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:08.472851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:08.475776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.590794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:08.592340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44f4c-1fba-440b-b5ba-fe7f5278a698 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:08.612969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 668/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:11.637475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:11.638066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:11.638066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:11.640030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 676/1344] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:11.646212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7a-5bf2-4ff1-b6f6-f5c790cd4026 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:11.647525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7a-5bf2-4ff1-b6f6-f5c790cd4026 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:11.647525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7a-5bf2-4ff1-b6f6-f5c790cd4026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:11.725439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-dea35c7a-5bf2-4ff1-b6f6-f5c790cd4026 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:11.726741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dea35c7a-5bf2-4ff1-b6f6-f5c790cd4026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:11.745580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:11.842094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 669/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:12.141343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:12.142932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:12.263899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ffa79-6449-4875-9922-221fdd2ead8a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:12.342697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:12.343310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:12.343589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:12.343858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:12.345481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:12.392854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:12.472266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:12.473765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d12db-1795-4839-a240-e0f2de207449 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:12.494979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 677/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:16.859355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:16.860150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:16.860433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:16.861824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 670/1347] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:16.867581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8598f-2f58-4815-a6ca-97350e9bda79 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:16.868185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8598f-2f58-4815-a6ca-97350e9bda79 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:16.868185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8598f-2f58-4815-a6ca-97350e9bda79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:16.953101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-18c8598f-2f58-4815-a6ca-97350e9bda79 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:16.954681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-18c8598f-2f58-4815-a6ca-97350e9bda79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:17.068800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:17.071883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 678/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:17.360096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:17.361896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:17.476916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2726e-cb71-49ad-9d33-4473618462ec None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:17.529938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:17.558132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:17.558809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:17.559097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:17.559369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:17.560980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:17.689285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:17.690970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcaee0-02a9-4b47-9a8a-f3028d806bc0 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:17.710774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 671/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:22.758887 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f2f-ec4c-4b64-86ab-47d31458ecc4 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:22.759336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f2f-ec4c-4b64-86ab-47d31458ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:22.759430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f2f-ec4c-4b64-86ab-47d31458ecc4 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:22.760859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 679/1350] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:22.766111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e480b-dd01-4cc9-96bf-eb448e254725 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:22.766934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e480b-dd01-4cc9-96bf-eb448e254725 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:22.767376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e480b-dd01-4cc9-96bf-eb448e254725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:22.869890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1a0e480b-dd01-4cc9-96bf-eb448e254725 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:22.872409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1a0e480b-dd01-4cc9-96bf-eb448e254725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:22.895596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:23.011436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 672/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:27.549324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d675a-66a3-4d04-bf26-fe025d25aa40 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:27.549858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d675a-66a3-4d04-bf26-fe025d25aa40 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:27.549858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d675a-66a3-4d04-bf26-fe025d25aa40 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:27.551392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 680/1352] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:27.557963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382a4-7fbe-4c5b-8414-661992356cb8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:27.558467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382a4-7fbe-4c5b-8414-661992356cb8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:27.558564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382a4-7fbe-4c5b-8414-661992356cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:27.645335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-495382a4-7fbe-4c5b-8414-661992356cb8 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:27.647613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-495382a4-7fbe-4c5b-8414-661992356cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:27.729034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:27.775268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 673/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:29.107635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf4b4-0457-4a00-a23a-c0ee0f2dda7c None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:29.108192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf4b4-0457-4a00-a23a-c0ee0f2dda7c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:29.108192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baf4b4-0457-4a00-a23a-c0ee0f2dda7c None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:29.109514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 681/1354] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:29.116510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad7e5-c631-41f5-9d6e-f0f38b5064c6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:29.116973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad7e5-c631-41f5-9d6e-f0f38b5064c6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:29.117085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad7e5-c631-41f5-9d6e-f0f38b5064c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:29.198455 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ec5ad7e5-c631-41f5-9d6e-f0f38b5064c6 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:29.199766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ec5ad7e5-c631-41f5-9d6e-f0f38b5064c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:29.319342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 674/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:32.664517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64d3b0-b462-475a-add1-e9c9f06ce870 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:32.665135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64d3b0-b462-475a-add1-e9c9f06ce870 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:32.665135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64d3b0-b462-475a-add1-e9c9f06ce870 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:32.666474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 682/1356] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:32.671752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeccaa-4b8b-488a-8003-5c8f932f20be None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:32.672162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeccaa-4b8b-488a-8003-5c8f932f20be None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:32.672311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeccaa-4b8b-488a-8003-5c8f932f20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:32.709257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:32.745256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0cdeccaa-4b8b-488a-8003-5c8f932f20be None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:32.746924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0cdeccaa-4b8b-488a-8003-5c8f932f20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:32.901969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 675/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:33.222631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:33.223993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:33.224693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:33.227595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 683/1358] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 30 14:48:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:33.235290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f039f-30c3-43c7-b5f0-ead5dae4ffab None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:33.235860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f039f-30c3-43c7-b5f0-ead5dae4ffab None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:33.236349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f039f-30c3-43c7-b5f0-ead5dae4ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:33.322857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-822f039f-30c3-43c7-b5f0-ead5dae4ffab None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:33.324721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-822f039f-30c3-43c7-b5f0-ead5dae4ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:33.392089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:33.472179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 676/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 30 14:48:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:33.479586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:33.481172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:33.635923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885edb7-aa02-437a-ba47-f3b486ad48ba None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:33.713979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:33.756411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:33.757189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:33.757574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:33.757969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:33.759710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:33.854226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:33.855873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b95757-8e2e-4e1e-8c6e-6561f893e8ea service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:33.874488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 684/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:36.060708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:36.061129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:36.061396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:36.062814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 677/1361] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:36.068093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66928-30d6-423d-a482-916a9b56b59b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:36.068800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66928-30d6-423d-a482-916a9b56b59b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:36.068800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66928-30d6-423d-a482-916a9b56b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:36.139024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-adb66928-30d6-423d-a482-916a9b56b59b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:36.140137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-adb66928-30d6-423d-a482-916a9b56b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:36.180649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:36.242363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 685/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:36.531712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:36.533383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:36.722725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eccd7-05d8-4027-b1f9-1dc14cff639e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:36.732998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:36.852557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:36.853166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:36.853442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:36.853711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:36.855339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:36.953223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:36.954854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9263a7d-3ae5-4973-b2d4-ec6217a226cd service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:36.976609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 678/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:39.443366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f6fd-c659-4f78-9258-bdb0f5ed7693 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:39.443904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f6fd-c659-4f78-9258-bdb0f5ed7693 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:39.443987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220f6fd-c659-4f78-9258-bdb0f5ed7693 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:39.445492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 686/1364] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:39.450974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820218f0-24c2-4c4f-88bd-12654ee364bc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:39.451517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820218f0-24c2-4c4f-88bd-12654ee364bc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:39.451892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820218f0-24c2-4c4f-88bd-12654ee364bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:39.469147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:39.525970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-820218f0-24c2-4c4f-88bd-12654ee364bc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:39.527372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-820218f0-24c2-4c4f-88bd-12654ee364bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:39.633941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 679/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:39.932650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:39.933238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:39.934199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:39.935728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 687/1366] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 30 14:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:39.941840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c268f2-e74a-433d-9806-5053aaedeac4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:39.943054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c268f2-e74a-433d-9806-5053aaedeac4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:39.943374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c268f2-e74a-433d-9806-5053aaedeac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:40.023598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-12c268f2-e74a-433d-9806-5053aaedeac4 None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:40.024821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-12c268f2-e74a-433d-9806-5053aaedeac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:40.063420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:40.151938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 680/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 30 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:40.160313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:40.162162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:40.322733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf88d-c537-406c-be7f-e0f4274740dd None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:40.343903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:40.448050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:40.448701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:40.448937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:40.449129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:40.451506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:40.555710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:40.557613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c3b10-2cec-454d-bd95-0cb90436b745 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:40.578576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 688/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:41.054020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665538-88a2-4d75-8986-7b53895e95d1 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.054648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665538-88a2-4d75-8986-7b53895e95d1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.054648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665538-88a2-4d75-8986-7b53895e95d1 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.056381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 681/1369] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:41.062478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c42e6-a299-4437-bf82-09fe0480902e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.062837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c42e6-a299-4437-bf82-09fe0480902e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.063048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c42e6-a299-4437-bf82-09fe0480902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.103706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:41.150355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2f7c42e6-a299-4437-bf82-09fe0480902e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:41.151832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2f7c42e6-a299-4437-bf82-09fe0480902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:41.261593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 689/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:41.861459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.861819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.862211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.865134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 682/1371] 10.222.0.47 () {54 vars in 964 bytes} [Tue Aug 30 14:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:41.870472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af2558-4e7c-46bd-848f-98d95d238b82 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.870957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af2558-4e7c-46bd-848f-98d95d238b82 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.871047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af2558-4e7c-46bd-848f-98d95d238b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.950242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-50af2558-4e7c-46bd-848f-98d95d238b82 None None] MFA Rules not processed for user `4a4ef96940de44a0a565e313f2ec7e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:41.951491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-50af2558-4e7c-46bd-848f-98d95d238b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:42.002765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:42.042048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 690/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Aug 30 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:42.046317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:42.047860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:42.158486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12023898-aae4-4c36-ba2f-24c50688db17 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:42.203031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:42.251035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:42.251671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:42.251963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:42.252238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:42.253987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:42.397978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:42.399879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acec568-224b-4e8a-add4-172c62481308 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:42.426739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 683/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:42.984025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:42.984564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:42.984683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:42.985966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 691/1374] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:42.991890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d3ea-861b-4575-a0f0-6a73c757c3da None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:42.992260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d3ea-861b-4575-a0f0-6a73c757c3da None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:42.992614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d3ea-861b-4575-a0f0-6a73c757c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:43.060606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-25f7d3ea-861b-4575-a0f0-6a73c757c3da None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:43.061834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-25f7d3ea-861b-4575-a0f0-6a73c757c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:43.083480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:43.161382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 684/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:43.454056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:43.455766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:43.606021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138d09-24fe-495a-8fa8-a8860364b190 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:43.658851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:43.721298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:43.721824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:43.722111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:43.722387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:43.724638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:43.814482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:43.815214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25c47-37d6-4339-850e-ac45ce091838 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:43.835474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 692/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:45.946505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:45.947000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:45.947121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:45.948387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 685/1377] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:45.954181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dac69-1692-4347-a763-b9f9b8489ac4 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:45.954664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dac69-1692-4347-a763-b9f9b8489ac4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:45.954849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dac69-1692-4347-a763-b9f9b8489ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:46.022478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e08dac69-1692-4347-a763-b9f9b8489ac4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:46.023744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e08dac69-1692-4347-a763-b9f9b8489ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:46.036067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:46.166186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 693/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:46.467419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:46.469208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:46.639182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc908ea-0154-44c0-9575-7c955e4448ec None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:46.643305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:46.760916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:46.761526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:46.761804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:46.762070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:46.763686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:46.864278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:46.865947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b641-8ca9-433c-9ec5-733e21ab3c4c service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:46.885127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 686/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:49.003644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:49.005257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:49.005257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:49.009353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 694/1380] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:49.012075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4581d-68f6-4564-853e-fb07c8484a18 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:49.012642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4581d-68f6-4564-853e-fb07c8484a18 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:49.012642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4581d-68f6-4564-853e-fb07c8484a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:49.025982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.094719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2df4581d-68f6-4564-853e-fb07c8484a18 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:49.095859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2df4581d-68f6-4564-853e-fb07c8484a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:49.197447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 687/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:49.493228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:49.494762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:49.654720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.662919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55650e-7b3c-4946-bf77-11063e1aea4e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:49.803728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:49.804669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:49.805076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:49.805437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:49.807313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:49.916304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:49.918192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e0ce1-6218-4680-a1c4-37a2eb3d6c0f service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:49.930270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.939828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 695/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:52.258935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:52.259597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:52.259597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:52.260886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 688/1383] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:52.266701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3612b5-12d7-4867-aa29-04061c77a9a2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:52.267152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3612b5-12d7-4867-aa29-04061c77a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:52.267279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3612b5-12d7-4867-aa29-04061c77a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:52.341997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-bc3612b5-12d7-4867-aa29-04061c77a9a2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:52.343238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bc3612b5-12d7-4867-aa29-04061c77a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:52.440600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 696/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:52.803656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:52.805693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:52.898815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:52.969661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10b071-bdfc-4c73-adbf-7d6199cf0920 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:53.115176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:53.115922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:53.116282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:53.116632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:53.118761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:53.180343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:53.225738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:53.227727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63a55b-245d-4b71-8523-49da3f651efb service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:53.250797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 689/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:55.325924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:55.326587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:55.326587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:55.327954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 697/1386] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:55.334023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad5f2-3803-4627-acab-58d61b116bb4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:55.334469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad5f2-3803-4627-acab-58d61b116bb4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:55.334690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad5f2-3803-4627-acab-58d61b116bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:55.404881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2c1ad5f2-3803-4627-acab-58d61b116bb4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:55.406148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2c1ad5f2-3803-4627-acab-58d61b116bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:55.505718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 690/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:55.804624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:55.806154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:55.905679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:55.990875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7699b2e-663b-41aa-af16-94d6bd528b67 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:56.119794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:56.120571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:56.120927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:56.121293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:56.123516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:56.171183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:56.233299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:56.234986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da770e-b5ca-4f39-9062-8982863e57f4 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:56.254280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 698/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:58.306012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:58.306611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:58.306611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:58.307920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 691/1389] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:48:58.312989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34929-3edf-41b7-9c4e-749b00ef4830 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:58.313388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34929-3edf-41b7-9c4e-749b00ef4830 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:58.313544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34929-3edf-41b7-9c4e-749b00ef4830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:58.379419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-add34929-3edf-41b7-9c4e-749b00ef4830 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:58.380726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-add34929-3edf-41b7-9c4e-749b00ef4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:58.477520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 699/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:58.773348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:58.779262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:58.808025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:58.927715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b063e96-703a-443e-8ddf-74222655cd8a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:59.026280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b943-2176-47f9-b3d5-1c83617f115e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.026604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b943-2176-47f9-b3d5-1c83617f115e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.026905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b943-2176-47f9-b3d5-1c83617f115e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.028505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 700/1391] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:48:59.033628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9be8ac-7e7d-44b5-85e5-6f3bd662e6bd None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.033762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:59.033919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9be8ac-7e7d-44b5-85e5-6f3bd662e6bd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.034937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9be8ac-7e7d-44b5-85e5-6f3bd662e6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.047506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:59.048115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.048396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.048665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.050408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:59.050932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:59.105347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8a9be8ac-7e7d-44b5-85e5-6f3bd662e6bd None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:59.106926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8a9be8ac-7e7d-44b5-85e5-6f3bd662e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:59.142163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:59.144378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cad819-5871-4a02-9439-1fb99b3248f8 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:59.163048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 692/1392] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:59.211542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 701/1393] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:59.515744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.516198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.516289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.517635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 693/1394] 10.222.0.47 () {54 vars in 967 bytes} [Tue Aug 30 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:59.523349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f913-3c59-4034-b361-40d471b78280 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.523748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f913-3c59-4034-b361-40d471b78280 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.523900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f913-3c59-4034-b361-40d471b78280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.607741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b155f913-3c59-4034-b361-40d471b78280 None None] MFA Rules not processed for user `914aa57ca54b416080fec74e374bac86`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:59.608942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b155f913-3c59-4034-b361-40d471b78280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:59.644999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:59.687618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 702/1395] 10.222.0.47 () {58 vars in 1064 bytes} [Tue Aug 30 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:59.695487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:59.697012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:59.802909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048f96a-39a3-43ab-9b7b-cf23780971ef None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:59.817859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:59.879373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:59.879993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:59.880255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:59.880522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:59.882140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:59.992599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:59.994035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4178-4479-49be-9681-6a00d995205d service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:00.013133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 694/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:00.924738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f9ea-d38c-499b-b6a0-75d37867a71d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:00.925392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f9ea-d38c-499b-b6a0-75d37867a71d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:00.925609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f9ea-d38c-499b-b6a0-75d37867a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:00.991788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2061f9ea-d38c-499b-b6a0-75d37867a71d None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:00.992981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2061f9ea-d38c-499b-b6a0-75d37867a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:01.080872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 703/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:01.124227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c507f-3e0a-470a-8116-17ad48149883 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.124731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c507f-3e0a-470a-8116-17ad48149883 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.124836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c507f-3e0a-470a-8116-17ad48149883 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.126112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 695/1398] 10.222.0.47 () {54 vars in 943 bytes} [Tue Aug 30 14:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:01.133443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.133729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.134001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.194666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.212825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] MFA Rules not processed for user `bb6314f7ac7e45b99d46d3e8a480150e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:01.214079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:01.262866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f61-90cb-465d-b755-16cb949a7897 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.263155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f61-90cb-465d-b755-16cb949a7897 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.263432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f61-90cb-465d-b755-16cb949a7897 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.264760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 696/1399] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:49:01.270202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.270520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.270804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.323187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 704/1400] 10.222.0.47 () {58 vars in 1040 bytes} [Tue Aug 30 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:01.325696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.340616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:01.340821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:01.341314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:01.343442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daadc4-ea94-4de2-ae21-98838b851fe9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:01.440913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 697/1401] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:01.445259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.450469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:01.451101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.451384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.451658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.453322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:01.539401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:01.541000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8216e4-35ae-4bcb-86ce-737320aab232 service swift] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:01.548907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 705/1402] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:49:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:49:01.733408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:01.734649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:01.854727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2140-dec5-4583-941a-615c2cff2764 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:01.869144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.993165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:01.993777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:01.994054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:01.994320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:01.995961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:02.097237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:02.099002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a5ae-096e-4431-a8a5-791edb943bf1 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:02.119985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 698/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:04.267799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:04.267799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:04.267799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:04.269056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 706/1404] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:49:04.274390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fafee-f94c-4f69-8cd7-d7cfe3dbf90f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:04.274891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fafee-f94c-4f69-8cd7-d7cfe3dbf90f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:04.274975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fafee-f94c-4f69-8cd7-d7cfe3dbf90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:04.296478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:04.353282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-464fafee-f94c-4f69-8cd7-d7cfe3dbf90f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:04.354536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-464fafee-f94c-4f69-8cd7-d7cfe3dbf90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:04.476536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 699/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:04.787965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:04.789853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:04.975508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:04.986895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719635-7119-4ddb-8b3f-b9011e9a3fea None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:05.139541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:05.155526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:05.155526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:05.155526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:05.155526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:05.267851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:05.269841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29269b26-3c23-4dd1-9dd6-3d3ff45e56aa service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:05.292276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 707/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:05.866426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:07.796006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:07.796613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:07.796613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:07.798473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 700/1407] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:07.803603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ede2-31ab-4914-9691-ac1affb4f508 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:07.804091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ede2-31ab-4914-9691-ac1affb4f508 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:07.804186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ede2-31ab-4914-9691-ac1affb4f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:07.876263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ad44ede2-31ab-4914-9691-ac1affb4f508 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:07.878382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ad44ede2-31ab-4914-9691-ac1affb4f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:07.981961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 708/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:08.278874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:08.280397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:08.387211 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:08.457316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb3e28-8bb7-49d2-bcee-78ec21ca43dd None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:08.590413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:08.590413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:08.590413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:08.590413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:08.590987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:08.656770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:08.701175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:08.702887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd55bb-a1e6-421f-a936-5d79323518f8 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:08.728898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 701/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:17.980010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=67 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:18.726306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=20 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:24.985825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817d0-ef3c-42a8-bed2-b2b762898a1b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:24.986654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817d0-ef3c-42a8-bed2-b2b762898a1b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:24.986654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817d0-ef3c-42a8-bed2-b2b762898a1b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:24.987788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 709/1410] 10.222.0.47 () {54 vars in 918 bytes} [Tue Aug 30 14:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:24.993057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c2c8-fc29-499c-a690-1f6a9b4e58ae None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:24.993508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c2c8-fc29-499c-a690-1f6a9b4e58ae None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:24.993604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c2c8-fc29-499c-a690-1f6a9b4e58ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:25.069971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a603c2c8-fc29-499c-a690-1f6a9b4e58ae None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:25.071232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a603c2c8-fc29-499c-a690-1f6a9b4e58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:25.179610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 702/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 30 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:25.194337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76226af-2ad7-4795-a90f-1d8fe0daacdf None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:25.194646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76226af-2ad7-4795-a90f-1d8fe0daacdf None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:25.194920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76226af-2ad7-4795-a90f-1d8fe0daacdf None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:25.196300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 710/1412] 10.222.0.47 () {54 vars in 918 bytes} [Tue Aug 30 14:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:25.200786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bc9-bcd2-41ea-8406-49c6eb3767dd None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:25.201073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bc9-bcd2-41ea-8406-49c6eb3767dd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:25.201343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bc9-bcd2-41ea-8406-49c6eb3767dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:25.278070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:25.280822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b98b9bc9-bcd2-41ea-8406-49c6eb3767dd None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:25.282043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b98b9bc9-bcd2-41ea-8406-49c6eb3767dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:25.398974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 703/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 30 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:27.830718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:27.831286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:27.831286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:27.832671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:27.838416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760da3-bda7-4520-8ef9-b9afdd54e3f5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:27.838934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760da3-bda7-4520-8ef9-b9afdd54e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:27.839029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760da3-bda7-4520-8ef9-b9afdd54e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:27.912784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8c760da3-bda7-4520-8ef9-b9afdd54e3f5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:27.914017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8c760da3-bda7-4520-8ef9-b9afdd54e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:27.972490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:28.017320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:28.310429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:28.312008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.456062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f0fc-cb97-48be-bc62-32d64e9a8a2e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:28.530465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:28.571798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:28.572410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:28.572691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:28.572963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:28.574664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.671774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:28.673436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b2fd6-f94a-4976-bdbd-bc863ffca6ea service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:28.692177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 712/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:29.594584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:29.601015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:29.601015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:29.601015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:29.601467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195841d4-6aac-4221-b911-87c8122c3e8b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:29.601860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195841d4-6aac-4221-b911-87c8122c3e8b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:29.602009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195841d4-6aac-4221-b911-87c8122c3e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:29.679433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-195841d4-6aac-4221-b911-87c8122c3e8b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:29.680637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-195841d4-6aac-4221-b911-87c8122c3e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:29.708091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:29.779163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:29.931596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:29.933046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:30.075865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cf1c1-7083-4bed-bfa0-9f58fc3eb384 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:30.115610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:30.189968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:30.190531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:30.190815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:30.191087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:30.192701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:30.284919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:30.286541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b9dd-a399-46fd-a9b3-3f18aab93993 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:30.304696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 706/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:49:31.222609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:31.223145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:31.223145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:31.224427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:31.229401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b29d-2918-4ab1-9dc3-a0efc154a87e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:31.229828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b29d-2918-4ab1-9dc3-a0efc154a87e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:31.229935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b29d-2918-4ab1-9dc3-a0efc154a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:31.286172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:31.307902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c288b29d-2918-4ab1-9dc3-a0efc154a87e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:31.312470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c288b29d-2918-4ab1-9dc3-a0efc154a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.404162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:31.559499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:31.560989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.708506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086d401-468e-411a-a630-8c96eb8ee589 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:31.721306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:31.828556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:31.829692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:31.830024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:31.830302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:31.832167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.920383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:31.921984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0a92-0a69-4625-bf0f-9e99e3acea98 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:31.940689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 715/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:32.805402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:32.805975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:32.805975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:32.807427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:32.812233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33dc2-1491-4c68-bc7e-1757118a5167 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:32.812669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33dc2-1491-4c68-bc7e-1757118a5167 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:32.812781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33dc2-1491-4c68-bc7e-1757118a5167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:32.834188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:32.893262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d3a33dc2-1491-4c68-bc7e-1757118a5167 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:32.894506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d3a33dc2-1491-4c68-bc7e-1757118a5167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:32.993557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:33.147952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:33.149375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:33.258638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:33.295789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a3002-4c72-4946-9e52-a924bcbe7bd9 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:33.409005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:33.409662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:33.409941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:33.410213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:33.411914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:33.495020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:33.508869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:33.510519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675900e-fdb1-4cc5-be1c-e8b231d5768d service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:33.529819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 709/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:34.410356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.411110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.411110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.412284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:34.417280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e85b-c4d0-45a3-9260-06628eaf093f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.417732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e85b-c4d0-45a3-9260-06628eaf093f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.417826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e85b-c4d0-45a3-9260-06628eaf093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.498863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8171e85b-c4d0-45a3-9260-06628eaf093f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:34.500103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8171e85b-c4d0-45a3-9260-06628eaf093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.607554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:34.766351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:34.768002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.863450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:34.931342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdff2-d7fa-4eeb-8cd7-51147d6bfc8e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.051804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.052333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.052641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.052916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.054572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:35.103795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:35.146003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.147656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d307241-485d-4051-b17d-4c06d7f9121c service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.165752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 718/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:36.048823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:36.049398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:36.049398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:36.050767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:36.055813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df7cd-26d6-4b19-8379-c2c64a625d35 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:36.056264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df7cd-26d6-4b19-8379-c2c64a625d35 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:36.056374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df7cd-26d6-4b19-8379-c2c64a625d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:36.130781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ab9df7cd-26d6-4b19-8379-c2c64a625d35 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:36.131991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ab9df7cd-26d6-4b19-8379-c2c64a625d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.228841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:36.380491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:36.381937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.432462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.531829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae39840-fd96-4267-9671-abb71da8b757 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:36.658779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:36.658779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:36.658779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:36.658779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:36.659473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.664636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.872786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:36.874783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0ceae-5b31-4647-82b3-b19ab9ba4a00 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:36.893920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 712/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:37.763550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:37.764160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:37.764160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:37.765465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:37.771028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6a67-63a8-4113-b689-40f9203a8c14 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:37.771521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6a67-63a8-4113-b689-40f9203a8c14 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:37.771644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6a67-63a8-4113-b689-40f9203a8c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:37.851467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-65fe6a67-63a8-4113-b689-40f9203a8c14 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:37.852721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-65fe6a67-63a8-4113-b689-40f9203a8c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:37.922266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:37.952431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:38.104315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:38.105777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:38.124449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:38.252736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77107ae-160c-4543-b9de-125b281ab215 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:38.341053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:38.368500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:38.369036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:38.369317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:38.369591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:38.371247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:38.460744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:38.462338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e9b44-53e2-418a-bcbe-c1738c8e273e service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:38.480770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 721/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:39.356654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.357244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.357244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.358538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:39.364204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227f19-e17a-4c5f-985f-ee2458077a22 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.364619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227f19-e17a-4c5f-985f-ee2458077a22 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.364750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227f19-e17a-4c5f-985f-ee2458077a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.441241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-32227f19-e17a-4c5f-985f-ee2458077a22 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:39.442650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-32227f19-e17a-4c5f-985f-ee2458077a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.484207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:39.538892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:39.692171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:39.693603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.841892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3946e3-8ac9-40e2-8524-066ecc445c9d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:39.898183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:39.956109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:39.956632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.956909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.957175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.958795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:40.045382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.047013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81306d67-031f-463b-8cb5-7d551fd75744 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.065681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 715/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:40.920673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.921233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.921233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.923185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:40.928170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478db9-0fac-4e7d-bb53-3db7d41e72d0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.928600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478db9-0fac-4e7d-bb53-3db7d41e72d0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.928726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478db9-0fac-4e7d-bb53-3db7d41e72d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.004985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b8478db9-0fac-4e7d-bb53-3db7d41e72d0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:41.006200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b8478db9-0fac-4e7d-bb53-3db7d41e72d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.008236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:41.102322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:41.258501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:41.260006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.408970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffe560-c1e6-4a6b-8eb0-94ac2aea92bb None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:41.436218 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:41.520912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:41.521519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:41.521797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:41.522067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.523702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.616867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:41.618516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8fc2a-5294-4f80-809b-e3ec91d7017c service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:41.637258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 724/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:43.476481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:43.477068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:43.477068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:43.478343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:43.483737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cd07-f6ef-41b4-8447-830bae73a1d0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:43.484167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cd07-f6ef-41b4-8447-830bae73a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:43.484304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cd07-f6ef-41b4-8447-830bae73a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:43.526199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:43.551403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9df0cd07-f6ef-41b4-8447-830bae73a1d0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:43.552622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9df0cd07-f6ef-41b4-8447-830bae73a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:43.652507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:43.938464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:43.940833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:44.044263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9d64-f1bc-45ce-af33-33c2fcc4ed16 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:44.076719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:44.119889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:44.120417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:44.120697 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:44.120969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:44.122618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:44.229979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:44.231550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43ad5-6614-46ca-a8bf-d38330979e69 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:44.251172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 718/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:46.326824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:46.327371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:46.327489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:46.328808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:46.334753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f99a3-ea57-439d-b152-432cd23f7f86 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:46.335162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f99a3-ea57-439d-b152-432cd23f7f86 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:46.335302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f99a3-ea57-439d-b152-432cd23f7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:46.399503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ac2f99a3-ea57-439d-b152-432cd23f7f86 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:46.400971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ac2f99a3-ea57-439d-b152-432cd23f7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:46.413702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:46.496909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:46.792884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:46.794414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:46.901866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a654-d04b-4b7b-ba4d-0d6f4bd2eda8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:46.914435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:46.976744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:46.977349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:46.977628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:46.977900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:46.979523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:47.090309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:47.091700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27c2e1-9740-45a9-911a-4cb480a54dd2 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:47.110581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 727/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:49.411225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.411796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.411796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.413112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:49.418482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bdaa-647c-40b1-88a4-7af978ba9ac5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.418951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bdaa-647c-40b1-88a4-7af978ba9ac5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.419087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bdaa-647c-40b1-88a4-7af978ba9ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.466527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:49.484690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9598bdaa-647c-40b1-88a4-7af978ba9ac5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:49.486508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9598bdaa-647c-40b1-88a4-7af978ba9ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.583737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:49.872383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:49.873913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.980522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca6b7e-eb37-418b-8d7b-f894b8c3f25a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:50.025798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:50.060204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:50.060818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:50.061102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:50.061378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:50.063045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:50.177266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:50.178643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3c1f4-0029-470b-b6c2-68181a9552d6 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:50.197269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 721/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:52.285908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.286370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.286505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.287869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:52.293399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd34d7-9356-42de-9d8d-762844b4c880 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.293849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd34d7-9356-42de-9d8d-762844b4c880 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.293962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd34d7-9356-42de-9d8d-762844b4c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.360431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-18fd34d7-9356-42de-9d8d-762844b4c880 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:52.361794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-18fd34d7-9356-42de-9d8d-762844b4c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:52.382977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:52.460943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:52.754523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:52.756097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:52.863010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423631f-85f6-42fe-b092-7633d0397a0d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:52.883448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:52.937891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:52.938553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.938972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.939281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.940939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:53.050468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:53.051826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ace6-4d13-4a6d-bb01-de2204b795cb service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:53.069999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 730/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:55.058474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.059028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.059028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.060265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:55.065590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93baf4-dd72-456e-8a15-a0af2141b84d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.066018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93baf4-dd72-456e-8a15-a0af2141b84d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.066133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93baf4-dd72-456e-8a15-a0af2141b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.131428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:55.133967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4d93baf4-dd72-456e-8a15-a0af2141b84d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:55.135212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4d93baf4-dd72-456e-8a15-a0af2141b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:55.231170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:55.513391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:55.514936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:55.617035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe32f-b724-4ac4-b9f7-55e7a97f1a12 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:55.666749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:55.695848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:55.696470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.696753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.697027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.698678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:55.808206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:55.809542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de14af-0264-466d-9e7d-1e2733173ca0 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:55.831209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 724/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:57.826199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.826790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.826888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.828338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:57.834381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e44d-25aa-47b5-add2-dec4cc1d8140 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.834812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e44d-25aa-47b5-add2-dec4cc1d8140 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.834955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e44d-25aa-47b5-add2-dec4cc1d8140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.901716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ed60e44d-25aa-47b5-add2-dec4cc1d8140 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:57.902968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ed60e44d-25aa-47b5-add2-dec4cc1d8140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:57.932336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:57.999547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:58.284915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:58.286466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:58.389657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194af39-bf90-4b3c-9b91-c8f4a02e41de None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:58.417842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:58.462464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:58.463085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:58.463372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:58.463650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:58.465291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:58.574521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:58.575927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f37da-d660-4b72-8417-6b7379ee1567 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:58.597662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 733/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:00.599600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:00.600149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:00.600149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:00.601430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:00.606791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b088ee6-1ced-457f-85f8-af18a1c14e3a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:00.607227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b088ee6-1ced-457f-85f8-af18a1c14e3a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:00.607337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b088ee6-1ced-457f-85f8-af18a1c14e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:00.677878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4b088ee6-1ced-457f-85f8-af18a1c14e3a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:00.679128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4b088ee6-1ced-457f-85f8-af18a1c14e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:00.687338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:00.777690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:01.067364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:01.069207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:01.173033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769af85-0621-43c8-a582-bb1eb0e4c52c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:01.226916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:01.244866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:01.245472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:01.245750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:01.246017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:01.247636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:01.357844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:01.359220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbba653-e5f5-4edc-b4f8-189cd0e557ac service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:01.378885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 727/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:03.356875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:03.357441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:03.357441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:03.358813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:03.364753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b381-7386-4637-8f7f-09792f3b5e10 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:03.365221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b381-7386-4637-8f7f-09792f3b5e10 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:03.365332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b381-7386-4637-8f7f-09792f3b5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:03.432330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4926b381-7386-4637-8f7f-09792f3b5e10 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:03.433553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4926b381-7386-4637-8f7f-09792f3b5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:03.472893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:03.531676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:03.816703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:03.818255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:03.923969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec959d9-fec1-4a42-8b85-28f48bc0a4bf None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:03.961481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:03.996798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:03.997463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:03.997873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:03.998200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:04.000383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:04.106978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:04.108329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a3675-6974-4dc9-a9a1-259a65ab9f83 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:04.126571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 736/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:06.061845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.062405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.062405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.064306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:06.069611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb04b-90e9-42b2-9314-805ce8ef730a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.070045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb04b-90e9-42b2-9314-805ce8ef730a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.070151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb04b-90e9-42b2-9314-805ce8ef730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.136463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c5dfb04b-90e9-42b2-9314-805ce8ef730a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:06.137590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c5dfb04b-90e9-42b2-9314-805ce8ef730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.156058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.234314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:06.528566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.530199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.632736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaedc97-9b81-4c53-8080-bde36138f6a2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.699663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.706992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.707634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.707914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.708193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.709854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.821864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.823258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadcf5-5d40-48b8-87bb-99963b8e312c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.842680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 730/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:08.797763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:08.798378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:08.798378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:08.800331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:08.805897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91ffa-21a7-4cbc-b41b-fe57d80d20ff None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:08.806361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91ffa-21a7-4cbc-b41b-fe57d80d20ff None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:08.806481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d91ffa-21a7-4cbc-b41b-fe57d80d20ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:08.874438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e6d91ffa-21a7-4cbc-b41b-fe57d80d20ff None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:08.875740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e6d91ffa-21a7-4cbc-b41b-fe57d80d20ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:08.924117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:08.971603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:09.257097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:09.258701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:09.362357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b77b-f645-4497-b892-67cdc8a458f9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:09.411137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:09.436450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:09.437060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:09.437341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:09.437660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:09.439443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:09.549097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:09.550471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38cdcf-b100-48c1-b29c-bf60cc033a3a service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:09.571018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 739/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:18.969433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=22 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:19.567762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=66 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:29.439788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00057-294e-447d-bc1b-95e21c62dec6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.440388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00057-294e-447d-bc1b-95e21c62dec6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.440388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00057-294e-447d-bc1b-95e21c62dec6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.441666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 732/1471] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:29.446877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0c63-d466-4e46-819b-b3c3c0a882fc None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.447321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0c63-d466-4e46-819b-b3c3c0a882fc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.447430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0c63-d466-4e46-819b-b3c3c0a882fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.515425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-18cd0c63-d466-4e46-819b-b3c3c0a882fc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.516681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-18cd0c63-d466-4e46-819b-b3c3c0a882fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:29.612579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 740/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:29.914467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.914760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.915045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.916367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 733/1473] 10.222.0.47 () {54 vars in 967 bytes} [Tue Aug 30 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:29.921264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88441f-1f08-46d2-8d7a-cc0e5dc5147f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.921553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88441f-1f08-46d2-8d7a-cc0e5dc5147f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.921854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88441f-1f08-46d2-8d7a-cc0e5dc5147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.997128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-df88441f-1f08-46d2-8d7a-cc0e5dc5147f None None] MFA Rules not processed for user `914aa57ca54b416080fec74e374bac86`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.998334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-df88441f-1f08-46d2-8d7a-cc0e5dc5147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.019898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.073614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 741/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:30.082012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:30.083948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.187886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74207-1c63-4a2f-9e8b-96ab07370bc6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:30.263472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:30.264079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.264400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.264894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.266678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.321938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.377509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:30.378903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9a4b2-4a2a-40bb-b293-695099a7c1a6 service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:30.398550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 734/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:32.420968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:32.421782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:32.421782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:32.422917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 742/1476] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:32.428301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58fce-bb53-4cbd-bd00-7eb309a072cd None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:32.428691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58fce-bb53-4cbd-bd00-7eb309a072cd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:32.428864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58fce-bb53-4cbd-bd00-7eb309a072cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:32.494456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f9f58fce-bb53-4cbd-bd00-7eb309a072cd None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:32.495714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f9f58fce-bb53-4cbd-bd00-7eb309a072cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:32.598480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 735/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:32.880884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:32.882346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:33.011033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3d1c-41c9-4f52-922c-ba8ddcfa7e55 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:33.062895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:33.108659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:33.109294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:33.109575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:33.109875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:33.110580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:33.112380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:50:33.112380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:50:33.112380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:50:33.113537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38619944-2bf6-44a4-b50b-e9969681f6e9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:33.132413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 743/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 30 14:50:32 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:35.074572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.075130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.075130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.076522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 736/1479] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:35.082420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d498-d594-48ba-80ec-8c8877d3d75e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.082882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d498-d594-48ba-80ec-8c8877d3d75e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.082994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d498-d594-48ba-80ec-8c8877d3d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.149266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6db0d498-d594-48ba-80ec-8c8877d3d75e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:35.150501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6db0d498-d594-48ba-80ec-8c8877d3d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:35.249496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 744/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:35.543064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:35.545251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:35.558845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:35.720025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e42ee-2702-435b-a0a7-b76df1238ad7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:35.806176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:35.842117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:35.842981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.843447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.843718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.845401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:35.937828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:35.939055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2290f6-8a62-4b5c-9a22-b8e688d40512 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:35.959503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 737/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:38.111579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:38.112137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:38.112137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:38.113466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 745/1482] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:38.119140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ae98-06c5-4761-a831-b80b6c652d59 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:38.119592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ae98-06c5-4761-a831-b80b6c652d59 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:38.119705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ae98-06c5-4761-a831-b80b6c652d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:38.187356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d618ae98-06c5-4761-a831-b80b6c652d59 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:38.188593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d618ae98-06c5-4761-a831-b80b6c652d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:38.236985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:38.294058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 738/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:38.594767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:38.596327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:38.621118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:38.704736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c14c9-e9ed-476f-a99d-e5ebdb2ff7ab None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:38.785463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:38.786087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:38.786372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:38.786691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:38.788370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:38.868129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:38.903768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:38.905860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bbe53-b657-4165-8919-c63e484ee679 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:38.925258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 746/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:40.962899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:40.963467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:40.963467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:40.964836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 739/1485] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:40.971149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186807e-7997-410d-8094-60d197d23718 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:40.971649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186807e-7997-410d-8094-60d197d23718 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:40.971745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186807e-7997-410d-8094-60d197d23718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:41.040161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2186807e-7997-410d-8094-60d197d23718 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:41.041391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2186807e-7997-410d-8094-60d197d23718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:41.141816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 747/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:41.428730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:41.430286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:41.537365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dd4d0-85e4-44f1-b136-5b1b754e16ee None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:41.612265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:41.614201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:41.614850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:41.615127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:41.615394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:41.617043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:41.728986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:41.730333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdcd66-7a0c-43b9-a9b2-0299fef56e8f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:41.749247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 740/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:43.902577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:43.903140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:43.903140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:43.904505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 748/1488] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:43.910010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e7e6-e11f-4489-9895-56234c1f172f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:43.910537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e7e6-e11f-4489-9895-56234c1f172f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:43.910646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e7e6-e11f-4489-9895-56234c1f172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:43.979056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2288e7e6-e11f-4489-9895-56234c1f172f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:43.980281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2288e7e6-e11f-4489-9895-56234c1f172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.033743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:44.078329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 741/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:44.366999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:44.368570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.406963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:44.476257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d86e4-8ae8-44d7-9480-2d5a2d455b7e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:44.551082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:44.551622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:44.551908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:44.552185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:44.553842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.643820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:44.674505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:44.676009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac51d-8eda-4b35-916c-f062cc7117a1 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:44.695501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 749/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:47.119473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:47.120016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:47.120016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:47.121289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 742/1491] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 30 14:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:47.127546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803140c3-8d48-4174-90b8-c52f47aecf04 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:47.127996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803140c3-8d48-4174-90b8-c52f47aecf04 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:47.128123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803140c3-8d48-4174-90b8-c52f47aecf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:47.197744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-803140c3-8d48-4174-90b8-c52f47aecf04 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:47.199031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-803140c3-8d48-4174-90b8-c52f47aecf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:47.299858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 750/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:47.588089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:47.589727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:47.700896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03299f1-6428-45c7-a91c-3483463c02c3 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:47.777742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:47.778358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:47.779225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:47.779547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:47.781175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:47.791327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:47.897291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:47.898728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046a2f2-62ae-49ff-94be-382e9260767c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:47.917816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 743/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:57.298005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=82 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:57.915194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=50 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.273934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.274571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.274571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.359267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:26.360481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.587869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 751/1494] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:26.595972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.596491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.596595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.678219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:26.679474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.784546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 744/1495] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:52:26.789191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:26.790398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.802939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923eb8d-9fe3-4ca3-ba5f-5f90801189c3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:26.880798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.920262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:26.920903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.921190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.921477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.923490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:52:26.923490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:26.924130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:26.924130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:52:26.924130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:52:26.925046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:26.936878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 752/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:52:26.945488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:26.955613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d324e0-7473-4d72-81a0-fef8f7b0705e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.029727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.076374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.077009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.077295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.077570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.078321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.080113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:27.080113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:52:27.080113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:52:27.081316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.230903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 745/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:52:26 2022] POST /identity/v3/projects => generated 379 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:52:27.236267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.238112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.274349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2294-1a6a-465a-abc1-77ff0da2d6e7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.377716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.378323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.378629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.378899 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.379522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.380756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:27.380756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:52:27.380756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:52:27.381951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.487225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 753/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:52:27 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:52:27.491902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.493438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.562683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfeef8-70d5-4de0-8c1a-d0fff1ac38d9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.664947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.676220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.676897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.677185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.677459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.678109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.679154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:27.679154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:52:27.679154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:52:27.680040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.694565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 746/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:52:27.698581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.700370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.718182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1213bb-b79e-4bbf-adb8-ed08e20dca46 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.747717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.826888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.827512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.828658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.828995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.829749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.830929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:27.830929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:52:27.830929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:52:27.831832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91cd38-45db-4d3d-b24f-4c96122ff50f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.846599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 754/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:52:27.851391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.852955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.892298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89e22-2912-4ba0-9d97-0b4357574033 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:28.019868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:28.020412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.020860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.020973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] PATH_INFO: `/v3/projects/49a603ec2ed84782bf838116b5e2785e/users/d477a15b57aa4d2295b66468805a79b2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.045064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a603ec2ed84782bf838116b5e2785e, user_id=d477a15b57aa4d2295b66468805a79b2, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:28.046094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:28.046094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:52:28.046094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:52:28.049283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ee738-8631-426a-a42b-482c79c450d4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:28.146388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 747/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:52:27 2022] PUT /identity/v3/projects/49a603ec2ed84782bf838116b5e2785e/users/d477a15b57aa4d2295b66468805a79b2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:28.159018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa72a-18ce-4341-83bd-5bcb31dc12df None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.159305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa72a-18ce-4341-83bd-5bcb31dc12df None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.159582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa72a-18ce-4341-83bd-5bcb31dc12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.232338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-bc1aa72a-18ce-4341-83bd-5bcb31dc12df None None] MFA Rules not processed for user `d477a15b57aa4d2295b66468805a79b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:28.234596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bc1aa72a-18ce-4341-83bd-5bcb31dc12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:28.364038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 755/1502] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:28.384245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.384666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.384947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.386293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 748/1503] 10.222.0.47 () {54 vars in 964 bytes} [Tue Aug 30 14:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:52:28.392549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384a47-9019-4436-bff0-9d7e072bea79 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.392828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384a47-9019-4436-bff0-9d7e072bea79 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.393100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384a47-9019-4436-bff0-9d7e072bea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.434646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:28.483021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f0384a47-9019-4436-bff0-9d7e072bea79 None None] MFA Rules not processed for user `4a4ef96940de44a0a565e313f2ec7e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:28.485343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f0384a47-9019-4436-bff0-9d7e072bea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:28.573858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 756/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Aug 30 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:28.588493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:28.590718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:28.655263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:28.722951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a1a81-bd62-400d-827e-627d8460f9df None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:28.812056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:28.813545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.813825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.814094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.815792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:28.926469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:28.927902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:28.931546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:28.950659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 749/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:28.997390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9b8b-8106-44b2-92b2-61b78129e433 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.997672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9b8b-8106-44b2-92b2-61b78129e433 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.997975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9b8b-8106-44b2-92b2-61b78129e433 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.999323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 757/1506] 10.222.0.47 () {52 vars in 830 bytes} [Tue Aug 30 14:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:52:29.004009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:29.005241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:29.117939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5e945-e15d-4895-9a3e-dc1ce9743376 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:29.219525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:29.220306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:29.220620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:29.221228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] PATH_INFO: `/v3/users/d477a15b57aa4d2295b66468805a79b2` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:29.236100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d477a15b57aa4d2295b66468805a79b2)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:29.237139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:29.237139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:52:29.237139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:52:29.238430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:29.249451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:29.490023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd477a15b57aa4d2295b66468805a79b2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:29.490530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd477a15b57aa4d2295b66468805a79b2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:29.580891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd477a15b57aa4d2295b66468805a79b2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:29.606133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd477a15b57aa4d2295b66468805a79b2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:29.624175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd477a15b57aa4d2295b66468805a79b2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:29.633990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 750/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:52:29 2022] DELETE /identity/v3/users/d477a15b57aa4d2295b66468805a79b2 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:29.645679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:29.646242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:29.646242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:29.725604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:29.726913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:29.826556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:29.842184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 758/1508] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:52:29.852540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:29.853808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:29.983080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929062c-03b4-4949-8e9e-2c8ee139fca8 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:30.057415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:30.092992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:30.092992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:30.092992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:30.092992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:30.094206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:30.228951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:30.230413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e930c-d61a-436f-859c-1173aa56918b service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:30.251564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 751/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:30.800468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:30.801926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:30.820358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fc4a1-0004-44e5-8e0b-3cf05b3a9457 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:30.951742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:30.952406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:30.952719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:30.953129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] PATH_INFO: `/v3/projects/49a603ec2ed84782bf838116b5e2785e` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:30.964892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a603ec2ed84782bf838116b5e2785e)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:30.965932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:30.965932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:52:30.965932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:52:30.967177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:31.108349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a603ec2ed84782bf838116b5e2785e', 'request_id': 'req-68ac1bcd-60a8-4864-8411-48fc93fe05d1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:31.284023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a603ec2ed84782bf838116b5e2785e', 'request_id': 'req-68ac1bcd-60a8-4864-8411-48fc93fe05d1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:31.299136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a603ec2ed84782bf838116b5e2785e', 'request_id': 'req-68ac1bcd-60a8-4864-8411-48fc93fe05d1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:31.327680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] The token cache is being invalidate because project 49a603ec2ed84782bf838116b5e2785e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:52:31.327977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:31.328526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-68ac1bcd-60a8-4864-8411-48fc93fe05d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:31.329922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 759/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:52:30 2022] DELETE /identity/v3/projects/49a603ec2ed84782bf838116b5e2785e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:40.248885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=62 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:41.325501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:07.649156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:07.649761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:07.649761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:07.651050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:07.656403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4226-1ace-4e71-844f-e75d264ab3ed None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:07.656878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4226-1ace-4e71-844f-e75d264ab3ed None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:07.656989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4226-1ace-4e71-844f-e75d264ab3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:07.737590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a0ab4226-1ace-4e71-844f-e75d264ab3ed None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:07.738830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a0ab4226-1ace-4e71-844f-e75d264ab3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:07.844739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:08.000156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:08.002701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:08.121148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541fa7-717e-47d4-a77c-a69c9b70b14b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:08.127348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:08.127955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:08.128234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:08.128505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:08.136572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:08.138135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c60a3b-2917-423f-bc61-605c10335a59 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:08.147765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 753/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:08.982992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f03e0-4bb4-4c00-b88c-58be243f4d56 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:08.983603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f03e0-4bb4-4c00-b88c-58be243f4d56 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:08.983815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f03e0-4bb4-4c00-b88c-58be243f4d56 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:08.985009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:08.989853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ef66-b2aa-47ec-a412-f20de48113f5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:08.990276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ef66-b2aa-47ec-a412-f20de48113f5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:08.990469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ef66-b2aa-47ec-a412-f20de48113f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:09.010513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1222ef66-b2aa-47ec-a412-f20de48113f5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:09.011720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1222ef66-b2aa-47ec-a412-f20de48113f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:09.019526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:09.173020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f03e0-4bb4-4c00-b88c-58be243f4d56 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:09.187189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f03e0-4bb4-4c00-b88c-58be243f4d56 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:09.192557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:09.193150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:09.193431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:09.193703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:09.201725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:09.203329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f94a7-57e0-4b2c-bf50-639f7f55abb2 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:09.212497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 762/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:09.399868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d23b2-81e3-471a-a0f5-fa01d539cd1b None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:09.400149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d23b2-81e3-471a-a0f5-fa01d539cd1b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:09.400421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d23b2-81e3-471a-a0f5-fa01d539cd1b None None] PATH_INFO: `/v3` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:09.401674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 755/1517] 10.222.0.48 () {54 vars in 925 bytes} [Tue Aug 30 14:54:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:54:09.408259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9eac-f582-46c2-be21-5fbe5c8c5d87 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:09.408570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9eac-f582-46c2-be21-5fbe5c8c5d87 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:09.408849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9eac-f582-46c2-be21-5fbe5c8c5d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:09.467813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-14bb9eac-f582-46c2-be21-5fbe5c8c5d87 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:09.469018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-14bb9eac-f582-46c2-be21-5fbe5c8c5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:09.486097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:09.540361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 763/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Aug 30 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:18.471247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb873c-a178-473f-aef1-933da68b6028 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:18.471760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb873c-a178-473f-aef1-933da68b6028 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:18.471760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb873c-a178-473f-aef1-933da68b6028 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:18.473124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 756/1519] 10.222.0.47 () {54 vars in 961 bytes} [Tue Aug 30 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:18.478131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d70-d435-4b16-a08d-042aea8c5594 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:18.478688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d70-d435-4b16-a08d-042aea8c5594 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:18.478789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651d70-d435-4b16-a08d-042aea8c5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:18.499489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d9651d70-d435-4b16-a08d-042aea8c5594 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:18.500783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d9651d70-d435-4b16-a08d-042aea8c5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:18.509470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 764/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Aug 30 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:18.517914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb873c-a178-473f-aef1-933da68b6028 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:18.532985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb873c-a178-473f-aef1-933da68b6028 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:18.538284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:18.538959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:18.539296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:18.539608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:18.548972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:18.550610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720624-d41a-4787-abb0-3166a9a59f99 service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:18.560662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 757/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:20.445677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611905ad-d70c-4ce8-850c-9fafd3f6be60 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.446308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611905ad-d70c-4ce8-850c-9fafd3f6be60 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.446308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611905ad-d70c-4ce8-850c-9fafd3f6be60 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.447692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:20.452665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16d72-27eb-4f3a-8e9d-38d6689ab8d7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.453113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16d72-27eb-4f3a-8e9d-38d6689ab8d7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.453221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16d72-27eb-4f3a-8e9d-38d6689ab8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.474965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1ab16d72-27eb-4f3a-8e9d-38d6689ab8d7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:20.476194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1ab16d72-27eb-4f3a-8e9d-38d6689ab8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:20.485004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:20.641069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611905ad-d70c-4ce8-850c-9fafd3f6be60 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:20.656662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611905ad-d70c-4ce8-850c-9fafd3f6be60 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:20.662093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:20.662722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.663011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.663290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.672329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:20.673854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afa747-ad1d-4ec9-bfe1-5ebc715492a1 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:20.683503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 766/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:21.509526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa92-ec85-40b1-9f46-1bdd5ee4b453 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:21.510073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa92-ec85-40b1-9f46-1bdd5ee4b453 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:21.510073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa92-ec85-40b1-9f46-1bdd5ee4b453 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:21.511416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:21.516839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ee08-9f54-447e-ad5d-cc7ae7f09253 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:21.517259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ee08-9f54-447e-ad5d-cc7ae7f09253 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:21.517540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ee08-9f54-447e-ad5d-cc7ae7f09253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:21.537309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1992ee08-9f54-447e-ad5d-cc7ae7f09253 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:21.538555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1992ee08-9f54-447e-ad5d-cc7ae7f09253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:21.546602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:21.699736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889aa92-ec85-40b1-9f46-1bdd5ee4b453 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:21.714318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889aa92-ec85-40b1-9f46-1bdd5ee4b453 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:21.720427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:21.721020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:21.721299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:21.721571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:21.729650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:21.731261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b818-9296-49c5-9871-9eca406060be service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:21.740356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 760/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:25.483712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:25.484293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:25.484293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:25.485587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:25.490858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dff4bc-c4e3-4357-9f1d-ae61cc7e10e8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:25.491313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dff4bc-c4e3-4357-9f1d-ae61cc7e10e8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:25.491412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dff4bc-c4e3-4357-9f1d-ae61cc7e10e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:25.511673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-41dff4bc-c4e3-4357-9f1d-ae61cc7e10e8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:25.512870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-41dff4bc-c4e3-4357-9f1d-ae61cc7e10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:25.521006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:25.802736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:25.804458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:25.885197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b8d1-12b0-4bce-9249-d3a621e974d3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:25.889494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:25.890114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:25.890394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:25.890835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:25.900243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:25.901775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65dc1-f678-4bc8-a40c-9dcddab7eead service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:25.911680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 769/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:27.812666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d45b30-a6e9-4dbe-81db-d7b9a0530aa2 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:27.813246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d45b30-a6e9-4dbe-81db-d7b9a0530aa2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:27.813246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d45b30-a6e9-4dbe-81db-d7b9a0530aa2 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:27.814612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:27.820024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6244dcb-fc39-40bb-9543-4e0b04f39540 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:27.820450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6244dcb-fc39-40bb-9543-4e0b04f39540 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:27.820645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6244dcb-fc39-40bb-9543-4e0b04f39540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:27.840364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c6244dcb-fc39-40bb-9543-4e0b04f39540 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:27.842199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c6244dcb-fc39-40bb-9543-4e0b04f39540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:27.850128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:28.140775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d45b30-a6e9-4dbe-81db-d7b9a0530aa2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:28.151533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d45b30-a6e9-4dbe-81db-d7b9a0530aa2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:28.155121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:28.155699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:28.155977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:28.156248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:28.164904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:28.166701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2e582-05c1-4c43-97d5-a9a468e1429d service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:28.175884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 763/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:31.910980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:31.911553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:31.911553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:31.912907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:31.918219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874dcec-d1a7-499a-b95d-015b84489ce3 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:31.918670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874dcec-d1a7-499a-b95d-015b84489ce3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:31.918820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874dcec-d1a7-499a-b95d-015b84489ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:31.927149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=81 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:31.939888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a874dcec-d1a7-499a-b95d-015b84489ce3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:31.941071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a874dcec-d1a7-499a-b95d-015b84489ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:31.948816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:54:32.503752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:32.505696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:32.571038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:32.584044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161bab-37d7-4024-968a-806cc7541fb2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:32.591778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:32.591778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:32.591778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:32.591778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:32.598300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:32.599754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea446-2816-44e4-9417-6e96bb23c585 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:32.609907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 772/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:34.557419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:34.557900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:34.558065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:34.560067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:34.565356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97649-0ce9-40b5-848b-4adc5acf30f1 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:34.565775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97649-0ce9-40b5-848b-4adc5acf30f1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:34.565928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c97649-0ce9-40b5-848b-4adc5acf30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:34.584977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-21c97649-0ce9-40b5-848b-4adc5acf30f1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:34.586249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-21c97649-0ce9-40b5-848b-4adc5acf30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:34.595451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:35.155306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:35.156987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:35.169850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235cd6f-1360-40ae-bc36-d72afabeb1e5 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:35.173508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:35.174103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:35.174384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:35.174689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:35.183403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:35.184933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510cef6-6961-46f8-953e-d915be8f29f2 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:35.194321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 766/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:44.579661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=11 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:45.190234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=8 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:02.364116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.365108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.365573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.390126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.391372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.404363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 774/1540] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.413657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00dae-f210-438b-b82a-f701010f3df6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.414238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00dae-f210-438b-b82a-f701010f3df6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.414238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00dae-f210-438b-b82a-f701010f3df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.444240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b6e00dae-f210-438b-b82a-f701010f3df6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.445485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b6e00dae-f210-438b-b82a-f701010f3df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.464885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 767/1541] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.469951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.486317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcf55b-4e5e-415c-b7af-1b2a0dfbf8d8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.493538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.494183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.494649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.494922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.495607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.495911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.497618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.508408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8015754-ac4d-4efc-9fce-7ef0ab955907 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.508804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8015754-ac4d-4efc-9fce-7ef0ab955907 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.508994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8015754-ac4d-4efc-9fce-7ef0ab955907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.515631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 775/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.526071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.541846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f25fd-154e-44df-a84c-290fafb60820 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.543630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f8015754-ac4d-4efc-9fce-7ef0ab955907 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.544861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f8015754-ac4d-4efc-9fce-7ef0ab955907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.553428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:56:02.559008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:56:02.559566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.564182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 768/1543] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:02.573272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.573604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.573880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.615768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.617212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.632373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 769/1544] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.639330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.648886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9f413-f4c3-4eee-9edd-5faec7216c4f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.659027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.659660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.659939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.660209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.660865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.661165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.662477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:02.662477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:56:02.662477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:56:02.663154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74edd29-27ee-49d2-b252-b584150fc898 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.676440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 776/1545] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:02.682197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.682526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 770/1546] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:02.688902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.689178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.689420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.723134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.724403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.846211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41453-7265-4556-9d07-67bc32784c38 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.856079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.857002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.857823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.859095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.859978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.861512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 771/1547] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.864504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.865161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476f72b-a2a2-4af0-a777-1628b37b332d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.888708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8112-203d-4fb9-9d75-627eefc892c7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.896584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.897526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.898028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.898590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.899465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.901764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26844-95dd-42d2-bc4f-13054ac3f42d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.966390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 777/1548] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.968104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8350e-fedd-4c6a-ae5a-01d07a9be94a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.968426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8350e-fedd-4c6a-ae5a-01d07a9be94a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.968655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8350e-fedd-4c6a-ae5a-01d07a9be94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.988647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7fc8350e-fedd-4c6a-ae5a-01d07a9be94a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.989866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7fc8350e-fedd-4c6a-ae5a-01d07a9be94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.994629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 772/1549] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.995883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf498-030a-4119-b008-ab60b3ee88ee None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.996172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf498-030a-4119-b008-ab60b3ee88ee None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.996454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf498-030a-4119-b008-ab60b3ee88ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.998806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 778/1550] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.999999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338841-ac8a-4a71-9fef-04ec3e175e89 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.000284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338841-ac8a-4a71-9fef-04ec3e175e89 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.000580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338841-ac8a-4a71-9fef-04ec3e175e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.020241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cd338841-ac8a-4a71-9fef-04ec3e175e89 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.021457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cd338841-ac8a-4a71-9fef-04ec3e175e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.021817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4fbaf498-030a-4119-b008-ab60b3ee88ee None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.023059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4fbaf498-030a-4119-b008-ab60b3ee88ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.082749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 779/1551] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.082987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 773/1552] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.084039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.084185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646624b8-a64b-45da-8ae2-6b91755fa4df None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.084313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.084440 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646624b8-a64b-45da-8ae2-6b91755fa4df None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.084598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.084704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646624b8-a64b-45da-8ae2-6b91755fa4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.106201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-646624b8-a64b-45da-8ae2-6b91755fa4df None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.107427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-646624b8-a64b-45da-8ae2-6b91755fa4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.108980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.110188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.115316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 774/1553] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.116739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb77cc-bfa3-4eeb-ac9e-9ff7d11a2477 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.116965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb77cc-bfa3-4eeb-ac9e-9ff7d11a2477 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.117242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb77cc-bfa3-4eeb-ac9e-9ff7d11a2477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.118120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 780/1554] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.119065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.129090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abca03c-aabb-4522-9a8f-e956675350b4 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.134629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.135304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.135589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.135863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.136516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.138107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.142948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bcfb77cc-bfa3-4eeb-ac9e-9ff7d11a2477 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.144087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bcfb77cc-bfa3-4eeb-ac9e-9ff7d11a2477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.151677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 781/1555] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.151677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.153366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 775/1556] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.154601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.154889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.155166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.162045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd875-6b00-4c4f-846a-f0b8af35ac76 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.167508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.168139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.168422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.168695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.169361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.171309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba839939-37cf-4554-bc0a-4f5750a135cc admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.176183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.177376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.186760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 776/1557] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.187737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.197746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93bd42-5ff6-4f65-b06d-5992ed6fde4a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.202194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.202850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.203128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.203396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.204054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.204351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.205953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd9e2e-2cf9-4f43-8498-846c845d0b66 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.217406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 777/1558] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.218575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622f68-b932-4a2c-8a56-b9419ca7f824 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.218865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622f68-b932-4a2c-8a56-b9419ca7f824 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.219187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622f68-b932-4a2c-8a56-b9419ca7f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.238525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-43622f68-b932-4a2c-8a56-b9419ca7f824 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.239703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-43622f68-b932-4a2c-8a56-b9419ca7f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.248066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 778/1559] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.251127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.251669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.254634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.265825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.271946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.273129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.273797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.286590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 782/1560] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.286590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9ed0b-5890-4dd1-acfb-0f2767576076 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.286878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 779/1561] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.286983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9ed0b-5890-4dd1-acfb-0f2767576076 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.286983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9ed0b-5890-4dd1-acfb-0f2767576076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.287157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.296531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14d2f-56fe-4eb2-aca2-4e1ada04491f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.301123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c9c9ed0b-5890-4dd1-acfb-0f2767576076 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.301266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.301806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.302089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.302308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c9c9ed0b-5890-4dd1-acfb-0f2767576076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.302415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.303023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.304602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.311354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 783/1562] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.317903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.317903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.317903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.318193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 780/1563] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.318193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.326727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2e52-4fbb-4feb-9638-ca741be9b61a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.331201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.331796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.332071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.332383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.333020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.333322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.334930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.337761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.339053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.347414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 784/1564] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.352529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 781/1565] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.352529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.352991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.360469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3495d5f-824d-441c-98ae-e1766b6a3d57 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.360661 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71253a7d-4c06-4253-9059-70ee35408426 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.365077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.365240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.365725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.365829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.366038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.366150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.366236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.366313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.366876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.366987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.367184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.369365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.369730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.381374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 782/1566] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.382279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.392486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676376f9-bea8-4a69-9821-e50cab2ec0c3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.397027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.397826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.398276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.398944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.399654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.401222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.411616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 783/1567] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.412386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.422816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2cdb-7c09-484d-90e2-4b48c6df602d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.427513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.428106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.428391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.428663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.429302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.429606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.431995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.443272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 784/1568] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.444044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.453302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda02b7-e167-4d91-a8a3-a168cc7ee63d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.457873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.458470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.458772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.459047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.459715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.460007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.461565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.475216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 785/1569] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.475216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.476967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 785/1570] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.476967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.485475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe38a3-b048-450d-883d-36fcbd5f34e0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.545665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.546547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.546829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.547110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] PATH_INFO: `/v3/projects/91df28a7c495424e8e3377f14ad6f5de/users/6188ad0d16f1411a953693c9a29dceb7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.552023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3a255-aad0-43fd-adcd-89ec2e29b147 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.557915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.558550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.558835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.559108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.559757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:03.560062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.561666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.562304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df28a7c495424e8e3377f14ad6f5de, user_id=6188ad0d16f1411a953693c9a29dceb7, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.565021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.573257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 786/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:03.574088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.583446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799779-73c7-4b4f-aab3-79b9aef7fe73 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.588135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.588772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.589019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.589447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.590072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.592086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.638735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 786/1572] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/91df28a7c495424e8e3377f14ad6f5de/users/6188ad0d16f1411a953693c9a29dceb7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:03.640319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.666781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 787/1573] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/projects => generated 357 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.666781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.707346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9210d-cf3e-414a-a202-ac225e933cf2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.719152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.729543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662719f-9dba-40ce-bc7c-158efe3d43b4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.734403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.734804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.735083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.735371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.736139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.737664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.748360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 788/1574] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.749290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.759551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1eb7-6894-4ceb-b214-89d4a408f1ec admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.764498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.765093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.765375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.765574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.765714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.766188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.766306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.766495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.766771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.767399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.768326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.769291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.880575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 789/1575] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.882122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.895787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 787/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.895969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.896098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.944466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8487-33e3-4662-acf1-60d3853c365a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.958073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11ef7-d899-4f74-bea9-7abf3d055b65 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.963437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.964051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.964328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.964627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.965270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.967227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.001485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.002102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.002387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.002712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.003380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.005295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555f5ae-3e10-4e66-a47a-64c69c41d288 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.083612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 788/1577] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.083612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.108544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 790/1578] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.112988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.112988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.112988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.129265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.130512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.144491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42b6c4-2393-403f-9136-1da312a65c9f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.150872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.151489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.151775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.152050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.152755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.154667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.189736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 791/1579] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.190596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.200475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8830246-61cf-4216-97bc-37583a4f9bd6 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.204980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.205575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.205859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.206134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.206789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.208718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.240109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 789/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.240999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.253382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.302092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bafc6-aa9f-4595-89f5-75cfe7ebc3d4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.307408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.308062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.308342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.308612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] PATH_INFO: `/v3/projects/2517d0cab754489ba9fd6e1b2361803f/users/fefb6724496b4e2b8b5d29f849ef3438/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.311266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 792/1581] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/users => generated 279 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.311928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.324244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed402-69f8-4bb6-b964-8a07c897a3f3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.324395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2517d0cab754489ba9fd6e1b2361803f, user_id=fefb6724496b4e2b8b5d29f849ef3438, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.327076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.328906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.329506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.329793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.330073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.330876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.332808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.396429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 790/1582] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:04 2022] PUT /identity/v3/projects/2517d0cab754489ba9fd6e1b2361803f/users/fefb6724496b4e2b8b5d29f849ef3438/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:04.397246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.425966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 793/1583] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.432500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.438019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f11d-bb87-4bcb-906c-4be7e3743597 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.448038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.466075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1fc2c-1811-4557-9218-9a49b81f321b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.472494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:56:04.481321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:56:04.482925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.502340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.502981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.503264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.503541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.504179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.506086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.559401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 791/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.560386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.569686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df670-8f1c-45c0-ad4d-abc5bd43affc admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.575457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.576039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.576322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.576596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.577231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.578852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.589086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 792/1585] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.590553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.621638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 794/1586] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.621638 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.630149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d2ee-1504-4a0a-8feb-eeb9cd815754 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.635405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.636003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.636310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.636566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.637224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.639188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.648141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096322b-d81a-4130-bfbb-8808fecc96e4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.651970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.652572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.652852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.653122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.662051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.663597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.672851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 793/1587] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.673632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.687934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99469-e2cc-4d50-88ef-e3fe936ca36f service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.692566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.693180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.693472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.693728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.694469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.696705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568ecd-5c10-4ab1-b56c-bd13ddb85333 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.706691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 794/1588] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.707896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.708183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.708469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.715948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.726956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.728196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.730873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 795/1589] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:04.740623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.740735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 795/1590] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.740735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.742110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b25ee-8b9d-449c-a3f3-c70b6d5f683b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.747989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.748597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.748868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.749139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.749785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.751769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be05b20-38e1-49a9-90b5-e5c9062eb227 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.751894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.756545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.757184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.757469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.757872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.759321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.760905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.763772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 796/1591] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.768337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.776001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 796/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.776001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.776258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ca8a4-62f9-4fd7-9f5b-1606b1d14b94 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.779493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.780916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.780916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.780916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.781235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.782942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.784104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39992-df22-4775-bacf-f884a123f7d9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.789364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.791923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.791923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.791923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.792237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.793597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 797/1593] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.793827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.794437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.807731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 797/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.807930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33daa4-bfa7-4449-a50c-7f9e72808f3d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.808069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.812821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.813574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.813964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.820088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.820088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.820088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.820409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91247-b597-42fa-be25-16ce75b8f3ce admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.825249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.826259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.826733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.827160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.828101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.829395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 798/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.830064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.832032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.832478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.845181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f973-64e0-46c7-a572-e30142a279a1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.846007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 798/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.846995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.850798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.850798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.850798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.850798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.857189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f15923-1397-4154-9ec0-0adceb493af6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.861441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.862439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.863068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.863371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.863475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.863650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.864391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.866066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.882062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 799/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.882282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 799/1598] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.882380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.882991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.892243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255322-7db5-4cf4-994d-842f0abebc0e service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.902533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.903400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.903754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.904112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] PATH_INFO: `/v3/projects/99a854f82f424133b14e38d30e99594e/users/d648eccdff80444f884c1fe56c8abe76/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.905744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d74-515a-4023-8330-a2bcba1ef776 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.912789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.913414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.913724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.914575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.916078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.917874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.922837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a854f82f424133b14e38d30e99594e, user_id=d648eccdff80444f884c1fe56c8abe76, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.924202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:04.924202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:56:04.924202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:56:04.926581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.928591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 800/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.929423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.940129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429ca4-be87-48df-9614-4b81c5fb3106 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.950961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.950961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.950961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.950961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.951341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.951341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.958301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 801/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:04.959091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.968336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ea8e-772f-4d15-aa67-9d62fdbc44c0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.972945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.973538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.973882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.974160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] PATH_INFO: `/v3/projects/2c4f5792627b47e49e13203cc30f9146/users/d6ff44b29fdc4568989b6c2bc88bf94e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.988800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4f5792627b47e49e13203cc30f9146, user_id=d6ff44b29fdc4568989b6c2bc88bf94e, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.991500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.063671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 800/1601] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:04 2022] PUT /identity/v3/projects/99a854f82f424133b14e38d30e99594e/users/d648eccdff80444f884c1fe56c8abe76/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.064721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.084523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 802/1602] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:04 2022] PUT /identity/v3/projects/2c4f5792627b47e49e13203cc30f9146/users/d6ff44b29fdc4568989b6c2bc88bf94e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.087066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.143081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075af1-584f-46b3-80c0-d35258b13e8a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.161002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.177476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326111-b8a6-45c3-a9e2-73b3415129c6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.184287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.184955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.185863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.186306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] PATH_INFO: `/v3/projects/c565f85952184c618f6f66ef8572537f/users/5922231c6fd14aa09702fe99b58e2bb7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.205148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c565f85952184c618f6f66ef8572537f, user_id=5922231c6fd14aa09702fe99b58e2bb7, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.207982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.214812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.217143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.217621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.218090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.220321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.221969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.234141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 801/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:05.234141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.245392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ddece-4cd3-4377-9f29-c3110151011a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.252252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.252551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.252902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.253250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] PATH_INFO: `/v3/projects/978e53cb67c54053911e4333ccd65f66/users/d04625404c4344bf9d1f11bc14ff69da/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.279846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978e53cb67c54053911e4333ccd65f66, user_id=d04625404c4344bf9d1f11bc14ff69da, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.283124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f2d6e-838c-40bc-8920-51a1e8017227 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.293092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 803/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/c565f85952184c618f6f66ef8572537f/users/5922231c6fd14aa09702fe99b58e2bb7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.294394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.357691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.368975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8d492-2d42-4f71-8316-c8ce93ba8370 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.373706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.374641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.374927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.375199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] PATH_INFO: `/v3/projects/01901764fc0b4afcafebec78c6f2b91a/users/613c1453a9794052a79a51c79d0ad8f1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.386871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 802/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/978e53cb67c54053911e4333ccd65f66/users/d04625404c4344bf9d1f11bc14ff69da/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.386871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46bc6d-3cfe-4f1a-a228-a3f71cb65cd5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.387552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46bc6d-3cfe-4f1a-a228-a3f71cb65cd5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.387970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46bc6d-3cfe-4f1a-a228-a3f71cb65cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.394122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01901764fc0b4afcafebec78c6f2b91a, user_id=613c1453a9794052a79a51c79d0ad8f1, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.396873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.412676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-de46bc6d-3cfe-4f1a-a228-a3f71cb65cd5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.414090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-de46bc6d-3cfe-4f1a-a228-a3f71cb65cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.477052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 803/1606] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:05.504704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944103c7-97ba-4604-abf7-f267a0401095 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.504704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944103c7-97ba-4604-abf7-f267a0401095 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.504704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944103c7-97ba-4604-abf7-f267a0401095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.507821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-944103c7-97ba-4604-abf7-f267a0401095 None None] MFA Rules not processed for user `d6ff44b29fdc4568989b6c2bc88bf94e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.509350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-944103c7-97ba-4604-abf7-f267a0401095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.525439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 804/1607] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/01901764fc0b4afcafebec78c6f2b91a/users/613c1453a9794052a79a51c79d0ad8f1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.526301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.606028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 804/1608] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:05.607789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978781-f044-42a5-95d6-25f9d16c2cfa None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.608306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978781-f044-42a5-95d6-25f9d16c2cfa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.608683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978781-f044-42a5-95d6-25f9d16c2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.614308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90fdd-2e7e-4576-9f66-2bd7039f172c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.633250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.634860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.635017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.635167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] PATH_INFO: `/v3/projects/da205cbecc274694a819f8f03d5331c8/users/c5385b90a497411d8eae5a85df4d6680/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.648007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-79978781-f044-42a5-95d6-25f9d16c2cfa None None] MFA Rules not processed for user `5922231c6fd14aa09702fe99b58e2bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.649264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-79978781-f044-42a5-95d6-25f9d16c2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.657998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da205cbecc274694a819f8f03d5331c8, user_id=c5385b90a497411d8eae5a85df4d6680, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.660604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.663564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c17280-3d33-44a6-af26-bd15828d7d3a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.720824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 805/1609] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:05.722545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.722842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.723124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.744527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.746128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.759307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 806/1610] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:05.759307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.777343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 805/1611] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/da205cbecc274694a819f8f03d5331c8/users/c5385b90a497411d8eae5a85df4d6680/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.780658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.780658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.780658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.800362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.801668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.832506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb8f93-9131-4a29-82c2-a6dd4ec9e813 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.880170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 806/1612] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:05.881028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.892304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41490e3-c670-450f-b5fc-9197fe585d3f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.892643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.893455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.893810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.894235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.898103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.898814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.899244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.899790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.900585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.902968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.906866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.912447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0234-4dfa-4499-8fc4-8ff3ce62aae2 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.922352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 807/1613] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:05.923955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516ff0-26b3-4116-99c8-39fa755edba8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.924423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516ff0-26b3-4116-99c8-39fa755edba8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.924773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516ff0-26b3-4116-99c8-39fa755edba8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.926378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 808/1614] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 30 14:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:05.927434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2516ff0-26b3-4116-99c8-39fa755edba8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.940566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2516ff0-26b3-4116-99c8-39fa755edba8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.944941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.945696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.947216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.947705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.960215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.962191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c30b-52c8-477c-9638-d8f7927fcca4 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.973202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 809/1615] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:05.976798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db43-6587-4d93-a37d-de67f3f9837a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.977601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db43-6587-4d93-a37d-de67f3f9837a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.978174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db43-6587-4d93-a37d-de67f3f9837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.998367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 807/1616] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:05.999669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.014549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-25b9db43-6587-4d93-a37d-de67f3f9837a None None] MFA Rules not processed for user `c5385b90a497411d8eae5a85df4d6680`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:06.015779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-25b9db43-6587-4d93-a37d-de67f3f9837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:06.040796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:06.058038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3aba-ebf8-431e-aa1f-75465db61103 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.058860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:06.061824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.062436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.062743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.063063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.088709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 810/1617] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:06.090861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798829f4-ff07-446a-8ea6-754aaee8b73b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.091353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798829f4-ff07-446a-8ea6-754aaee8b73b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.091639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798829f4-ff07-446a-8ea6-754aaee8b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.141024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-798829f4-ff07-446a-8ea6-754aaee8b73b None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:06.142749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-798829f4-ff07-446a-8ea6-754aaee8b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:06.145014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.147232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.160869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 808/1618] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:06.162210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.199488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6dc8-96c0-4908-9f6f-4ba2d898ecb9 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.207738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.208532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.208827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.209106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.210221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.213522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa145f4-a6f7-49ad-96b6-ff29b20fb54c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.228331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 811/1619] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:06.229869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a46c4-5e5a-4627-a36d-91ef8380f15b None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.230287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a46c4-5e5a-4627-a36d-91ef8380f15b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.230701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a46c4-5e5a-4627-a36d-91ef8380f15b None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.232611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 812/1620] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 30 14:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:06.239812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.240306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.240681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.266427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:06.267797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:06.291116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 813/1621] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:06.292382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.304860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a9a4-525b-4f58-a600-49a7c97d226a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.312273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.322426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.322426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.322426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.323058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 809/1622] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:06.323058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.323058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.323058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.361481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] MFA Rules not processed for user `fefb6724496b4e2b8b5d29f849ef3438`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:06.362775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:06.395856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.398136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.413011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 814/1623] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:06.414030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.427540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abe1e-d8bb-44bf-8bf3-21412f4d03dc service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.435439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.437681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.437681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.437681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.448581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.451546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.465025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 815/1624] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:06.466092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.478819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf597-aea1-447c-8023-7b1a892e0684 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.488128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.494811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 810/1625] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:06.495891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.496397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.496768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.496968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.497771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.499557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.515767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 816/1626] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:06.516004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76264-a5df-4b85-b0d4-fde7eb610c5d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.517912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.528489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.529291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.531593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.531988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.532753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.537767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.539470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027fbd7-7eca-47c0-babf-ec5d93756890 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.562716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.567749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.568234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.568512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] PATH_INFO: `/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f/users/d07b85f2d123424cad477b2087f8bc3e/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.615097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c045c0fa94a9430399d9722a0bb9fa3f, user_id=d07b85f2d123424cad477b2087f8bc3e, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.619701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.708890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 811/1627] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:06.710164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.761184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 817/1628] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:06 2022] PUT /identity/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f/users/d07b85f2d123424cad477b2087f8bc3e/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:06.764821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.778926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:06.904124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f0677-c918-4c55-92de-4ad8b568bccb admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.941752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ce5d7-1eb1-4a51-a229-ea74619bb9ca admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.952908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:06.953539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.953869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.954147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.956062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:06.959982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527fab3-3c8f-4bb3-a191-39d8d20e4230 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.981450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 818/1629] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:06.982808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10c47-32e4-402b-b394-4348a94aabd8 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.983103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10c47-32e4-402b-b394-4348a94aabd8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.983383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10c47-32e4-402b-b394-4348a94aabd8 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.989048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 819/1630] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 30 14:56:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:06.989950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10c47-32e4-402b-b394-4348a94aabd8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.013026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10c47-32e4-402b-b394-4348a94aabd8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.020507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.021728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.022604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.022748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.024722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.025911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.028650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:07.029073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.030035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.030382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] PATH_INFO: `/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f/users/d07b85f2d123424cad477b2087f8bc3e/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.032610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330a2d-1289-4872-9834-63dd8d56bf5a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.036380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c045c0fa94a9430399d9722a0bb9fa3f, user_id=d07b85f2d123424cad477b2087f8bc3e, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.040932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc930e-70b8-44f0-9af7-e4fac849e4a1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.060985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 820/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:06 2022] PUT /identity/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f/users/d07b85f2d123424cad477b2087f8bc3e/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:07.062293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.062611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.062893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.086013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:07.088177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:07.173581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 812/1632] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/users => generated 309 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:07.173581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a0f1-cda5-40c9-8e22-5ab354fc5cfe None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.173581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a0f1-cda5-40c9-8e22-5ab354fc5cfe None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.173581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a0f1-cda5-40c9-8e22-5ab354fc5cfe None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.174156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 813/1633] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 30 14:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:07.175589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d1d7-c593-4bf4-bca9-5a4f4c3e103c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.177606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d1d7-c593-4bf4-bca9-5a4f4c3e103c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.178366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d1d7-c593-4bf4-bca9-5a4f4c3e103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.183953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 821/1634] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:07.185423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.223784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2e22d1d7-c593-4bf4-bca9-5a4f4c3e103c None None] MFA Rules not processed for user `d07b85f2d123424cad477b2087f8bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:07.225382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2e22d1d7-c593-4bf4-bca9-5a4f4c3e103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:07.325042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd84c-ac00-4930-a2ec-99dbb5e6e8f2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.334474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.338811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 814/1635] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:07.341717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.341717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.342696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.342696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.342696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.343116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.343116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.353572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.375793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:07.377513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:07.582396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 822/1636] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:07.582396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.585773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 815/1637] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:07.585773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.588457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fd2d-1f9d-41c0-86d2-9ce9840041ed admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.588457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.588457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.588457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.589407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.589642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a7118-2fe3-4dca-a1d2-9567ec731b27 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.589642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.589642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.589642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.590141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.590269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.590269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.590269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 823/1638] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:07.590656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.590656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.590869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.591043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 816/1639] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:07.598526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f293ac-f79b-4d86-aed2-406e10251eb4 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.620093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.620942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.621596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.625022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] PATH_INFO: `/v3/projects/b75cdaa8e23f499e98a0e321305d11ba/users/39761e17706741d199b3f1e2a1637d43/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.662111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75cdaa8e23f499e98a0e321305d11ba, user_id=39761e17706741d199b3f1e2a1637d43, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.672442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.741735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.741735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1bb40-4364-4738-a4fb-6609e147947d service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.744017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.744645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.744949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.745715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.760484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.762835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.776201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 817/1640] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:07.878610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 824/1641] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:07 2022] PUT /identity/v3/projects/b75cdaa8e23f499e98a0e321305d11ba/users/39761e17706741d199b3f1e2a1637d43/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:07.879724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.899726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de4f1-c3c9-4d24-90d0-dbab98680592 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.015741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:08.032168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.032837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.034305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.034898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.035181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.036907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.039405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.046204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604687fd-12c2-4668-a080-fd8d567a1b9b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.052797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.053457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.053751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.054209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] PATH_INFO: `/v3/users/c5385b90a497411d8eae5a85df4d6680` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.056142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5385b90a497411d8eae5a85df4d6680)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.057509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: WARNING py.warnings [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:08.057509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: warnings.warn(msg) Aug 30 14:56:08.057509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: Aug 30 14:56:08.059062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.065355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 818/1642] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:08.066254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.143808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bd923-6ab2-4473-8d45-eed169d5599c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.148682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.150152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.150864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.151202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.231518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:08.251234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.252675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.269060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 819/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:08.270525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.291615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1bf6-0697-4700-af34-df825be7f14e service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.298311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.300835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.301350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.301959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] PATH_INFO: `/v3/projects/b75cdaa8e23f499e98a0e321305d11ba/users/39761e17706741d199b3f1e2a1637d43/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.322163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75cdaa8e23f499e98a0e321305d11ba, user_id=39761e17706741d199b3f1e2a1637d43, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.327863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb9049-f688-4f42-b0d4-6cbf94019e9b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.356539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 820/1644] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:08 2022] PUT /identity/v3/projects/b75cdaa8e23f499e98a0e321305d11ba/users/39761e17706741d199b3f1e2a1637d43/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:08.405960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5385b90a497411d8eae5a85df4d6680'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.441605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5385b90a497411d8eae5a85df4d6680'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.442790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5385b90a497411d8eae5a85df4d6680'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.443563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5385b90a497411d8eae5a85df4d6680'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.557404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5385b90a497411d8eae5a85df4d6680'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.589868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.590365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.590520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.598698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 825/1645] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:08 2022] DELETE /identity/v3/users/c5385b90a497411d8eae5a85df4d6680 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:08.620939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:08.622221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.692948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 821/1646] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:08.710090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.712279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.794631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e811a-fa6b-4894-8003-7c96cdef7af3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.798467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.799369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.799875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.800420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.844576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.847802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33c70-2145-4573-8e2d-6fbaeb6834f6 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.860094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 826/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:10.263061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.265912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:10.289173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca48d-4521-43af-a2f6-db444cfe20f7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.303301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:10.315232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.318554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.319774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.320215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] PATH_INFO: `/v3/projects/da205cbecc274694a819f8f03d5331c8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.323443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da205cbecc274694a819f8f03d5331c8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.325349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: WARNING py.warnings [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:10.325349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: warnings.warn(msg) Aug 30 14:56:10.325349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: Aug 30 14:56:10.333490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.559678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da205cbecc274694a819f8f03d5331c8', 'request_id': 'req-e45baf89-6857-45a5-830f-68c5fe994e76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.687660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da205cbecc274694a819f8f03d5331c8', 'request_id': 'req-e45baf89-6857-45a5-830f-68c5fe994e76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.720443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da205cbecc274694a819f8f03d5331c8', 'request_id': 'req-e45baf89-6857-45a5-830f-68c5fe994e76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.754758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] The token cache is being invalidate because project da205cbecc274694a819f8f03d5331c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:10.757599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.757599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e45baf89-6857-45a5-830f-68c5fe994e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.759070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 822/1648] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:10 2022] DELETE /identity/v3/projects/da205cbecc274694a819f8f03d5331c8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:10.764001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.764547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.764770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.802990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:10.838577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:10.843550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:10.949613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 827/1649] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:10.957439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.957845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.958592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.003306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:11.004971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:11.023094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 823/1650] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:11.027869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.043368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee45ea-cc5f-491e-a984-dac918298895 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.058478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.059921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.060409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.060832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.062260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:11.063216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.065515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.081468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 828/1651] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:11.085663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.101218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876d0f-486a-44f6-9384-cfef38b92beb None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.114577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.115296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.115702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.116118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.117349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.119619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.276864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 824/1652] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:11.281786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.305510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5314cb-bad1-4c4d-bbc1-598226b8ef0d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.533929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.538793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.540665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.541172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.542642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.550676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.777346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 829/1653] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/users => generated 294 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:11.782135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.796589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617f46-a4de-4301-8efc-b1f857253d27 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.809011 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.810816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.811105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.811435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.818003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.824950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.864572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 825/1654] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:11.869485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.886675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab3a42-66c4-4672-a448-40e80c6123c6 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.902648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.903295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.903577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.903851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.904517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.906664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08725-65e3-4196-8c8c-0d6fcd5f37b2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.925340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 830/1655] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:11.926847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.945129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecbeb-fb96-4f58-8edb-95702f5db414 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.970048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.970048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.970048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.970397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] PATH_INFO: `/v3/projects/79889529b6504e3fb61237fad10a008f/users/61dd29ddcf524f22843204e96882489b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.005750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79889529b6504e3fb61237fad10a008f, user_id=61dd29ddcf524f22843204e96882489b, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.011515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:12.228075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 826/1656] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:11 2022] PUT /identity/v3/projects/79889529b6504e3fb61237fad10a008f/users/61dd29ddcf524f22843204e96882489b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:12.237397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1343-fb57-4295-b7ca-b9d28b5021a9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.237732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1343-fb57-4295-b7ca-b9d28b5021a9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.238875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1343-fb57-4295-b7ca-b9d28b5021a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.387813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5d7a1343-fb57-4295-b7ca-b9d28b5021a9 None None] MFA Rules not processed for user `61dd29ddcf524f22843204e96882489b`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:12.389094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5d7a1343-fb57-4295-b7ca-b9d28b5021a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:12.632678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:12.640199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 831/1657] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:12.836243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:12.907938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ce75-74b5-442f-8a49-4cff4c4e4ce4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.925609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.926313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.926627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.944757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.948600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.950492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.064881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.065454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.065454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.076501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:13.118338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 827/1658] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:12 2022] POST /identity/v3/projects => generated 387 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:13.120195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.167480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] MFA Rules not processed for user `39761e17706741d199b3f1e2a1637d43`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:13.170464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:13.358842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f4217-751e-48e3-aa93-c30de2555edc admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:13.371269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:13.371922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.372205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.372770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.373138 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:13.382504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.453827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 832/1659] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:13.456454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.460183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:13.480295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824424-ae69-46d3-a5fb-fa6bf51e01fe None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:13.494552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:13.496368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.496809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.497398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] PATH_INFO: `/v3/users/5922231c6fd14aa09702fe99b58e2bb7` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.499013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=5922231c6fd14aa09702fe99b58e2bb7)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:13.501813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.594938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 828/1660] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:13 2022] POST /identity/v3/users => generated 300 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:13.596212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.637841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b8baa-6791-4dd3-a1f8-dc616aaf2c5d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:13.654721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:13.655599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.659277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.659807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.660668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:13.663158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.694005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 829/1661] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:13.702341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.715866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3ab9-546c-448c-83dd-162e05d2e925 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:13.723009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:13.723737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.724020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.724297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] PATH_INFO: `/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c/users/e6d4599af4f345f4878605fabbbca7a9/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.745294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef5f7a7a9c54be29aa965fecb30f34c, user_id=e6d4599af4f345f4878605fabbbca7a9, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:13.750060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.807335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5922231c6fd14aa09702fe99b58e2bb7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:13.849448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5922231c6fd14aa09702fe99b58e2bb7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:13.854277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 830/1662] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:13 2022] PUT /identity/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c/users/e6d4599af4f345f4878605fabbbca7a9/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:13.859225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5922231c6fd14aa09702fe99b58e2bb7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:13.861274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5922231c6fd14aa09702fe99b58e2bb7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:13.862362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.865204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:13.953029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f13d359e-2efc-466d-bc6c-9a3d8352e4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5922231c6fd14aa09702fe99b58e2bb7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:13.995091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 833/1663] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:13 2022] DELETE /identity/v3/users/5922231c6fd14aa09702fe99b58e2bb7 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:13.999056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6062-d2e5-4474-a4e2-577521cc1132 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.000742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6062-d2e5-4474-a4e2-577521cc1132 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.001868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6062-d2e5-4474-a4e2-577521cc1132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.069770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7ffb6062-d2e5-4474-a4e2-577521cc1132 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.076888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7ffb6062-d2e5-4474-a4e2-577521cc1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.099478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80241f-2f62-4796-acd8-a6db86c8d47a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:14.231014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 834/1664] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.232627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.233191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.233685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.284354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:14.285010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.285295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.285615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.286288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:14.290118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:14.311545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] MFA Rules not processed for user `6188ad0d16f1411a953693c9a29dceb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.318922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.349797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 831/1665] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:14.349797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.353362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.512330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 835/1666] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.513367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.551327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d9ab5-f0f7-47f2-b088-55ce968c8db1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:14.552090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba77a5-78f5-421c-bb04-89e6f5de4885 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:14.557274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:14.557957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.558236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.558555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] PATH_INFO: `/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c/users/e6d4599af4f345f4878605fabbbca7a9/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.560648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef5f7a7a9c54be29aa965fecb30f34c, user_id=e6d4599af4f345f4878605fabbbca7a9, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:14.564220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d158d-9623-44b8-8ed8-55113126dae2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:14.565186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:14.566129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.566578 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.566959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.603010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:14.603010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59028-8083-4e29-ae2e-1fc96fdfba6e service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:14.625068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:14.627278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 836/1667] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:14 2022] PUT /identity/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c/users/e6d4599af4f345f4878605fabbbca7a9/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:14.629634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.630092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.630569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.639098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 832/1668] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:14.651874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.652610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.652965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.696388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] MFA Rules not processed for user `6188ad0d16f1411a953693c9a29dceb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.701733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.769745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] MFA Rules not processed for user `e6d4599af4f345f4878605fabbbca7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.771048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.887857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 837/1669] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.914902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:14.922098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.924545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.990665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 833/1670] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.992747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.006824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.108303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210508ff-efe3-4331-be02-c32e0a6328d4 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.125356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.126286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.126599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.126874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.135565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d733df-5acf-40f4-8f9d-deab4ea6b198 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.146118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.146794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.147077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.147350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.148068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.152411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.178364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 838/1671] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:15.200466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.205902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586128e5-4404-4a9f-a778-27199c5052ca service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.253910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 834/1672] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:15.364454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.503960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f2ab-5fd1-4993-b709-d87d4c566486 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.508689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.509330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.509618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.509900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] PATH_INFO: `/v3/users/61dd29ddcf524f22843204e96882489b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.511109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dd29ddcf524f22843204e96882489b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.524340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.759498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dd29ddcf524f22843204e96882489b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:15.802543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dd29ddcf524f22843204e96882489b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:15.804144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dd29ddcf524f22843204e96882489b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:15.806189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dd29ddcf524f22843204e96882489b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:15.834947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:15.948667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e97db517-fb41-476e-8728-892c2543f65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dd29ddcf524f22843204e96882489b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:15.948667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 839/1673] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:15 2022] DELETE /identity/v3/users/61dd29ddcf524f22843204e96882489b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:15.951041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.951514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.952035 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.003880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:16.007374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.048647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b1e-4847-4a64-9ed3-0b436d8ad454 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.048938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b1e-4847-4a64-9ed3-0b436d8ad454 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.049222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b1e-4847-4a64-9ed3-0b436d8ad454 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.051033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 840/1674] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:16.071967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:16.079656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.083409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.083409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.132214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:16.134669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.144392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 835/1675] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:16.187528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.189189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.270132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 841/1676] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:16.283951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.285879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.307049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8da0-d40e-4818-860d-2711c33ad269 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.313954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.315167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.315299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.315834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.316390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813927ec-d144-4a52-9a81-3a98966064fc None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.325036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.325540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.325696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.326036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.329985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.329985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.347263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 842/1677] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:16.350353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.352390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.377982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 836/1678] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:16.912437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.914851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.952391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bac7b-10ec-4652-9661-22efe7ba569b service placement] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.962506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.962506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.962506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.962506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] PATH_INFO: `/v3/projects/79889529b6504e3fb61237fad10a008f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.962898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79889529b6504e3fb61237fad10a008f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.965106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.981390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:17.080061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79889529b6504e3fb61237fad10a008f', 'request_id': 'req-8cb5f2d4-b6c6-4f63-8b19-739850e27334'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.156183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79889529b6504e3fb61237fad10a008f', 'request_id': 'req-8cb5f2d4-b6c6-4f63-8b19-739850e27334'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.166017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79889529b6504e3fb61237fad10a008f', 'request_id': 'req-8cb5f2d4-b6c6-4f63-8b19-739850e27334'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.186556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] The token cache is being invalidate because project 79889529b6504e3fb61237fad10a008f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:17.195870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.195870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8cb5f2d4-b6c6-4f63-8b19-739850e27334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.195870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 843/1679] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:16 2022] DELETE /identity/v3/projects/79889529b6504e3fb61237fad10a008f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:17.196265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.207882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335f3b-4db0-49ed-b4c0-23ac2c18b712 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.248487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc73c8-5d2c-426f-b2bf-3ebcd347f4b0 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.249086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc73c8-5d2c-426f-b2bf-3ebcd347f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.250708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc73c8-5d2c-426f-b2bf-3ebcd347f4b0 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.254049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 844/1680] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 30 14:56:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:17.263171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.264196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.265373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.295018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.299241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.299539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.299830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] PATH_INFO: `/v3/users/e6d4599af4f345f4878605fabbbca7a9` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.303224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d4599af4f345f4878605fabbbca7a9)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.307847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.338470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:17.340162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.411199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 845/1681] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:17.491418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.494156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.511463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861434cc-5e4f-4af9-bc31-798c1cd16b66 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.521315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.526214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.526649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.526873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:17.527120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.541650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d4599af4f345f4878605fabbbca7a9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.543965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d4599af4f345f4878605fabbbca7a9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.549082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.553648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.576828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 846/1682] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:17.577933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.580195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.597292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347347bc-1387-4194-b443-5d22c8c79228 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.604746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.605521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.605909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.606297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] PATH_INFO: `/v3/projects/c565f85952184c618f6f66ef8572537f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.607602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c565f85952184c618f6f66ef8572537f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.610049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.629727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d4599af4f345f4878605fabbbca7a9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.669150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d4599af4f345f4878605fabbbca7a9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.696276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e99fe1e2-0abd-4d77-b61d-cc8bbe7e8270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d4599af4f345f4878605fabbbca7a9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.711553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 837/1683] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:17 2022] DELETE /identity/v3/users/e6d4599af4f345f4878605fabbbca7a9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:17.794687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c565f85952184c618f6f66ef8572537f', 'request_id': 'req-b31f49ba-9e0f-4583-86b0-c4d61a20e207'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.929964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c565f85952184c618f6f66ef8572537f', 'request_id': 'req-b31f49ba-9e0f-4583-86b0-c4d61a20e207'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.939178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c565f85952184c618f6f66ef8572537f', 'request_id': 'req-b31f49ba-9e0f-4583-86b0-c4d61a20e207'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.961970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] The token cache is being invalidate because project c565f85952184c618f6f66ef8572537f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:17.961970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.962117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b31f49ba-9e0f-4583-86b0-c4d61a20e207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:17.967403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 847/1684] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:17 2022] DELETE /identity/v3/projects/c565f85952184c618f6f66ef8572537f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:17.972683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.972683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.972683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.010560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:18.018102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.146206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 838/1685] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:18.154671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.154969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.155385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.188854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:18.197215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.203732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 848/1686] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:18.207670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.228987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc3f84-6bb4-40d8-8f5e-cbdde68008e6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.234002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.234795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.235145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.235486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.236255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:18.236629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.238379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.260852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 839/1687] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:18.262479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.274737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981557-6504-4d06-afdb-702aa8230f42 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.281956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.282862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.283309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.284133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.285004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.289536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.424334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 849/1688] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:18 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:18.428224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.446650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5608855-d26a-4292-92b5-867e58a9f3b3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.539172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.541631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.656484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.657264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.657439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.657794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.659362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.662320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.717272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b243cac-82a1-4fb6-a469-cadd7dd6a4ac admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.727061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.727681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.728193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.728739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] PATH_INFO: `/v3/users/fefb6724496b4e2b8b5d29f849ef3438` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.730166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefb6724496b4e2b8b5d29f849ef3438)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.732475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.812839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 840/1689] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:18 2022] POST /identity/v3/users => generated 284 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:18.814321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.823144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.848119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971515-d641-4ffd-a61f-da9b5fceb743 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.863789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.864710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.865070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.865407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] PATH_INFO: `/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.870012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef5f7a7a9c54be29aa965fecb30f34c)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.871733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.954570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefb6724496b4e2b8b5d29f849ef3438'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.984080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefb6724496b4e2b8b5d29f849ef3438'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.985027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefb6724496b4e2b8b5d29f849ef3438'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.985663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefb6724496b4e2b8b5d29f849ef3438'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.061233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:19.062129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:19.089502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef5f7a7a9c54be29aa965fecb30f34c', 'request_id': 'req-73bcf868-e52b-4c5c-bd60-78495d89cb0c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.122331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefb6724496b4e2b8b5d29f849ef3438'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.141747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 850/1690] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:18 2022] DELETE /identity/v3/users/fefb6724496b4e2b8b5d29f849ef3438 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:19.142746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.144548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.214808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef5f7a7a9c54be29aa965fecb30f34c', 'request_id': 'req-73bcf868-e52b-4c5c-bd60-78495d89cb0c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.227714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef5f7a7a9c54be29aa965fecb30f34c', 'request_id': 'req-73bcf868-e52b-4c5c-bd60-78495d89cb0c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.257528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] The token cache is being invalidate because project bef5f7a7a9c54be29aa965fecb30f34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:19.258435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.259368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.262745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 841/1691] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:18 2022] DELETE /identity/v3/projects/bef5f7a7a9c54be29aa965fecb30f34c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:19.266258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.269849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.287303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7eb2c-e309-4367-b245-931c9bfdef6c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.299142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.303663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.303663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.303663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.303663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.303663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e2eb9-5a01-4aae-ae67-b35fc4bf8b00 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.330145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 851/1692] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:19.333893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ceab-22dd-45e2-a749-a0a8570866fe None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.334211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ceab-22dd-45e2-a749-a0a8570866fe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.334511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ceab-22dd-45e2-a749-a0a8570866fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.383647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8984ceab-22dd-45e2-a749-a0a8570866fe None None] MFA Rules not processed for user `6188ad0d16f1411a953693c9a29dceb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:19.384943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8984ceab-22dd-45e2-a749-a0a8570866fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.448777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf868-e52b-4c5c-bd60-78495d89cb0c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.535353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 852/1693] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:19.536768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.537055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.537328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.584926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:19.588055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.611281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.613723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.614170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.614872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.616476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 853/1694] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:19.617745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.620266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.621423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.659356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.660974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888c3da-3aa0-4cd8-9a08-351a5ca9c69d service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.665598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31348283-f53b-4647-8c85-8b059efc8342 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.686905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.687770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.688260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.688370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 842/1695] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:19.688749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.690037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.690372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.690831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.691324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.695777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.723697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 854/1696] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:19.732959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.789086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:19.790772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.807125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c1736-5f7e-4b18-86a6-f6df68cc693a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.818146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 843/1697] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:19.823015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.836140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.836140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.837718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.838086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] PATH_INFO: `/v3/projects/4e3347af766545398c9fa3a8f4708be8/users/ef3ae3776de64fd59c5a2762216be3e0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.875451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea5709-9d36-4819-9ac8-69eb8be28d7a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.877711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3347af766545398c9fa3a8f4708be8, user_id=ef3ae3776de64fd59c5a2762216be3e0, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.884834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9862-ab2c-4325-a6d0-33d5c0f9d4ff admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.897646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.897646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.897646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.897646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.898592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:19.920673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.923882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.956751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 844/1698] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:19.959883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.986457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42531591-58d3-47b9-bfec-c0bb1f87a614 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.995110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 855/1699] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:19 2022] PUT /identity/v3/projects/4e3347af766545398c9fa3a8f4708be8/users/ef3ae3776de64fd59c5a2762216be3e0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:20.007913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.008274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.008519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.104779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] MFA Rules not processed for user `ef3ae3776de64fd59c5a2762216be3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:20.106108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:20.124837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:20.128430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.129646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.131095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.133005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:20.135202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:20.295819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 856/1700] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:20.296647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:20.298242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:20.313134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b01d6c-9859-4384-810b-5c9e5aa0bfd5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:20.318003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:20.318694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.318976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.319304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] PATH_INFO: `/v3/projects/2517d0cab754489ba9fd6e1b2361803f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.321434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2517d0cab754489ba9fd6e1b2361803f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:20.323768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:20.362966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 845/1701] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:19 2022] POST /identity/v3/projects => generated 387 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:20.364601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:20.368834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:20.514615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438dab-11f6-4ec5-973d-5279c4537dfa admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:20.526406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2517d0cab754489ba9fd6e1b2361803f', 'request_id': 'req-ea481e9c-2a25-487f-8e69-3077a4bcf251'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:20.646401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2517d0cab754489ba9fd6e1b2361803f', 'request_id': 'req-ea481e9c-2a25-487f-8e69-3077a4bcf251'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:20.658592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2517d0cab754489ba9fd6e1b2361803f', 'request_id': 'req-ea481e9c-2a25-487f-8e69-3077a4bcf251'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:20.680173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:20.681619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.683801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.686871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.692226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] The token cache is being invalidate because project 2517d0cab754489ba9fd6e1b2361803f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:20.693833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:20.694978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:20.701168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 857/1702] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:20 2022] DELETE /identity/v3/projects/2517d0cab754489ba9fd6e1b2361803f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:20.708351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:20.708351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:20.862208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:20.910143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481e9c-2a25-487f-8e69-3077a4bcf251 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:20.927308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:20.927530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:20.927962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.928256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.928537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.929309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:20.930065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:20.931403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:20.963968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 846/1703] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:20.968853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:21.017945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:21.040359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44ee-3fa3-4c5e-9704-aeb4fa6c3f97 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:21.060063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:21.060063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:21.060322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:21.063424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] PATH_INFO: `/v3/users/39761e17706741d199b3f1e2a1637d43` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:21.068417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39761e17706741d199b3f1e2a1637d43)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:21.078858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:21.087755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 858/1704] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:20 2022] POST /identity/v3/users => generated 294 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:21.092622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:21.140432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d9c8-3581-446f-ac0d-9d1000d29297 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:21.162487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:21.165468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:21.167054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:21.168762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:21.170261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:21.175906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:21.216785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 859/1705] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:21.221070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:21.246934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f601-443e-48b2-8b12-18aebb75ddd4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:21.268012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:21.268650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:21.268931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:21.269205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:21.269860 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:21.271865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:21.291449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 860/1706] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:21.295886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:21.347411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ead37-b225-43fd-96b1-5f9ff395a309 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:21.368927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:21.369907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:21.370409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:21.371078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] PATH_INFO: `/v3/projects/7fff672f063547ed8343cdfb02e18e3f/users/190e368d616a493dbc7aac606b294ead/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:21.384155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39761e17706741d199b3f1e2a1637d43'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:21.391044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39761e17706741d199b3f1e2a1637d43'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:21.423289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fff672f063547ed8343cdfb02e18e3f, user_id=190e368d616a493dbc7aac606b294ead, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:21.434864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f950237-ea6d-4c33-840b-a213fb13c27e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:21.464255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39761e17706741d199b3f1e2a1637d43'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:21.500380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39761e17706741d199b3f1e2a1637d43'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:21.531510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39761e17706741d199b3f1e2a1637d43'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:21.551781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 861/1707] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:21 2022] PUT /identity/v3/projects/7fff672f063547ed8343cdfb02e18e3f/users/190e368d616a493dbc7aac606b294ead/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:21.556280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 847/1708] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:20 2022] DELETE /identity/v3/users/39761e17706741d199b3f1e2a1637d43 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:21.565628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:21.565925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:21.566203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:21.639328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] MFA Rules not processed for user `190e368d616a493dbc7aac606b294ead`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:21.642985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:21.836476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:21.839986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 862/1709] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:21.840178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:22.076874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926948-d9af-432a-a784-a6c9aa1cb9d3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:22.082004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:22.082586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.082873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.083145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.083802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:22.085824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:22.269399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:22.273084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:22.280100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 848/1710] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:21 2022] POST /identity/v3/projects => generated 387 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:22.285186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:22.338398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3e46-a925-4f59-844c-94fd0b8613aa None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:22.468555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:22.469489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.470010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.470512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] PATH_INFO: `/v3/projects/b75cdaa8e23f499e98a0e321305d11ba` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.472442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75cdaa8e23f499e98a0e321305d11ba)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:22.481629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:22.527674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e66b-f015-4953-9280-13b8259d0e43 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:22.546424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:22.547985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.548442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.548870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.549678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:22.554722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:22.718320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75cdaa8e23f499e98a0e321305d11ba', 'request_id': 'req-42ed3b56-0f59-418d-954d-98c4e48d98a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.749347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 849/1711] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:22 2022] POST /identity/v3/users => generated 300 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:22.755514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:22.821605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75cdaa8e23f499e98a0e321305d11ba', 'request_id': 'req-42ed3b56-0f59-418d-954d-98c4e48d98a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.829191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2076c-be9b-45cc-b379-3b3f2d08df05 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:22.837778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75cdaa8e23f499e98a0e321305d11ba', 'request_id': 'req-42ed3b56-0f59-418d-954d-98c4e48d98a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.863864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] The token cache is being invalidate because project b75cdaa8e23f499e98a0e321305d11ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:22.864827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.867074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-42ed3b56-0f59-418d-954d-98c4e48d98a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.870307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 863/1712] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:22 2022] DELETE /identity/v3/projects/b75cdaa8e23f499e98a0e321305d11ba => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:22.875446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0728e0-da4a-4cd6-bdf2-cd7f9f74da31 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.876041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0728e0-da4a-4cd6-bdf2-cd7f9f74da31 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.876546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0728e0-da4a-4cd6-bdf2-cd7f9f74da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.942966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ee0728e0-da4a-4cd6-bdf2-cd7f9f74da31 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:22.951879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ee0728e0-da4a-4cd6-bdf2-cd7f9f74da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.099733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.105309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.105652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.105992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.110568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.121560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.126920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 864/1713] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:23.139762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.140408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.154874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.162605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 850/1714] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:23.167107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.177130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.216469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84192-571c-429f-bad1-37841540f8d2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.229453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.230160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.230472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.230796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] PATH_INFO: `/v3/projects/183d91147e764074b81a8ea0704c1243/users/189e1dc2129e44368310bae003e838fc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.259037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.268000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.309953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=183d91147e764074b81a8ea0704c1243, user_id=189e1dc2129e44368310bae003e838fc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.310122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 865/1715] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:23.313292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.321846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.355784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e37d4-ca2b-4ba1-bd07-e75e890a5f54 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.365873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:23.383407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.384759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.399569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.400108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.401913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:23.411057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.411057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.453239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 851/1716] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:23 2022] PUT /identity/v3/projects/183d91147e764074b81a8ea0704c1243/users/189e1dc2129e44368310bae003e838fc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:23.456617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.463120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 866/1717] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:23.465275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.495642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26aab-94a8-4e96-9c68-d3d7399b930d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.565981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:23.599346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.600168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.602810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.606086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.606086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.606266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.735880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 867/1718] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:23.743869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.765281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b84-721c-4108-83c6-b0fe087afaee admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.936132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f8398-9376-4fbc-a7c4-7ad0f5927e5e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.944981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.946017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.946473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.946909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.947764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.949815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.950487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.950815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.951108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.951562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.951766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.953366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9b1e-ae75-4488-bf5a-0f69d483bce1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.986191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 852/1719] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:24.002072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.003876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.007311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.052534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] MFA Rules not processed for user `613c1453a9794052a79a51c79d0ad8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:24.054295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.121198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 868/1720] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/users => generated 286 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:24.125375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.191826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325ea4-8211-4eda-a9c1-02d80d75de14 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.218296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.219767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 853/1721] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:24.222017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.224018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.224306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] PATH_INFO: `/v3/projects/183d91147e764074b81a8ea0704c1243/users/189e1dc2129e44368310bae003e838fc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.231254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183d91147e764074b81a8ea0704c1243, user_id=189e1dc2129e44368310bae003e838fc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.232941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.237898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.284494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912763a-b185-484e-bd35-65e6c8e70e0c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.297067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 869/1722] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:24 2022] PUT /identity/v3/projects/183d91147e764074b81a8ea0704c1243/users/189e1dc2129e44368310bae003e838fc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:24.301149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.305883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.455592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352447-5287-48f2-9dd4-71a3ba521337 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.464790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.467546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.470422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.471232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.532345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.532345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.532345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.532345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.532753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.540411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903895-d579-4b04-b5fe-9559c1d4e423 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.604257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 854/1723] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:24.626208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.626208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.626208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.709481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.721156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.756454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 870/1724] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:24.757493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.768738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] MFA Rules not processed for user `189e1dc2129e44368310bae003e838fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:24.777182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.785255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738d05-2b79-40f8-b842-c037792e74b3 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.836825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.839462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.839462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.839462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.839462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.848628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.882151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 871/1725] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:24.886644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.927262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b30ae-8686-46fe-a83c-254f667e7b16 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.939146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.941284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.941284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.943517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] PATH_INFO: `/v3/projects/7f4cd6801df24b8fb79bc3e5fbd12a85/users/cf6c6404c482494288fcc6153d9cf187/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.000516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4cd6801df24b8fb79bc3e5fbd12a85, user_id=cf6c6404c482494288fcc6153d9cf187, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.008160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96ccb-062d-4edc-b06f-24d03e5d06b0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.016638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 855/1726] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:25.029052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.030691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.119763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 872/1727] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:24 2022] PUT /identity/v3/projects/7f4cd6801df24b8fb79bc3e5fbd12a85/users/cf6c6404c482494288fcc6153d9cf187/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:25.133655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.133856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.134140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.179500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] MFA Rules not processed for user `cf6c6404c482494288fcc6153d9cf187`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:25.188401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.188805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3230b-fb8c-42dd-acc8-5f56e0c94031 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.304473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.311149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.311149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.311149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.413964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 873/1728] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:25.418675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.451548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.454427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.505792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 856/1729] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:25.688362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f01a-3758-44c1-a6af-cfb5e5b6ac35 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.718864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.721340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.721675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.722182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.722884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.727793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.808466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.842608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64700429-1469-4597-b7db-932206e8c2c9 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.861904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.865293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.865954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.867206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] PATH_INFO: `/v3/users/190e368d616a493dbc7aac606b294ead` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.872511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=190e368d616a493dbc7aac606b294ead)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.874355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.915669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 874/1730] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:25 2022] POST /identity/v3/projects => generated 371 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:25.916738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.209317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7851-5886-4439-a86f-34ea8d03088f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.218634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190e368d616a493dbc7aac606b294ead'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:26.222708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190e368d616a493dbc7aac606b294ead'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:26.229094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.232036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.245046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.246973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.262962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.280550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72479c6-5ee2-4481-967d-809ef4ffad02 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.429754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190e368d616a493dbc7aac606b294ead'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:26.464399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 875/1731] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:25 2022] POST /identity/v3/users => generated 292 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:26.482582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.483004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.483291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.484833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190e368d616a493dbc7aac606b294ead'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:26.502848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190e368d616a493dbc7aac606b294ead'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:26.519681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 857/1732] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:25 2022] DELETE /identity/v3/users/190e368d616a493dbc7aac606b294ead => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:26.528667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.532403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.561382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:26.652468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a674d-3e10-4544-a300-42b1ab11de7f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.659215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.660140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.660571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.661990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.663335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.665267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ebc80-cfb9-4d8a-9917-7c474a033a89 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.681245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 858/1733] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:26.681498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.682003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.682286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.720595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:26.721150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.722386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:26.726344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.751490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 859/1734] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:26.753521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.767834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3820-8602-404f-b61e-62feef1a05c9 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.774036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.774769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.775056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.775335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] PATH_INFO: `/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436/users/602f2bd6939d452e8b514d11b1f63c0a/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.809275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b2a9f6fc6a4bb4a68d06da42d18436, user_id=602f2bd6939d452e8b514d11b1f63c0a, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.835539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.946667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 876/1735] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:26.947634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.952415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.978170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:26.983729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 860/1736] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:26 2022] PUT /identity/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436/users/602f2bd6939d452e8b514d11b1f63c0a/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:26.992277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.065086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade2f60-9856-4c6d-9fd7-e891b972e686 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.238892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc105c-8bd1-409e-9724-160ab14061c4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.252614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.254892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.256029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.261610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.264728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.265371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.265655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.265932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.266624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.268241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027924c8-5bbf-476c-80cb-30821b9e4b1b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.276929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.279522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.305326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 877/1737] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:27.308424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 861/1738] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:27.313041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.335604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e454f7-dc64-4054-911c-373e7d0b0e1a service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.350951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.351953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.352404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.352794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] PATH_INFO: `/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436/users/602f2bd6939d452e8b514d11b1f63c0a/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.357170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b2a9f6fc6a4bb4a68d06da42d18436, user_id=602f2bd6939d452e8b514d11b1f63c0a, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.364317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.393377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 878/1739] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:27 2022] PUT /identity/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436/users/602f2bd6939d452e8b514d11b1f63c0a/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:27.405075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.405299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.405575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.462407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] MFA Rules not processed for user `602f2bd6939d452e8b514d11b1f63c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:27.463949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:27.551607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.555008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:27.650735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 862/1740] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:27.666219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.668004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:27.802096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e2d47-437c-414d-8a73-f41a2b62be15 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.803667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142643c1-6c3c-4b76-81bd-c6bb02e78055 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.821190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.824127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.824428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.824708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.825677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.829244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.829593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.835832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.856612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.859868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.903590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 863/1741] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:27.974203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.991914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3bea8-190a-400e-b5ab-9c926ad1ed7e service swift] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:28.017055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 879/1742] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:56:28.166807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:28.181984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eedcf-5a8c-4e5b-8e86-abf2eae2170d service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:28.200413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:28.204567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.206535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.206984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.216624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:28.467564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:28.469131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:28.500517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 864/1743] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:29.005857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:29.006385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:29.006385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:29.061528 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:29.064282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:29.094292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:29.263503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 880/1744] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Aug 30 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:29.278181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:29.281195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:29.318673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:29.329952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff8c0-2bfd-4162-a8b7-d17c6b5f9889 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:29.352122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:29.356876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:29.356876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:29.357132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:29.357607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:29.387088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:29.388550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4566171-e323-410c-a0d0-87777505f450 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:29.419500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 881/1745] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:29.420967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee831-2357-4061-8f93-fcf1ae76f215 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:29.424435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee831-2357-4061-8f93-fcf1ae76f215 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:29.424728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee831-2357-4061-8f93-fcf1ae76f215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:29.556610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-84eee831-2357-4061-8f93-fcf1ae76f215 None None] MFA Rules not processed for user `d648eccdff80444f884c1fe56c8abe76`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:29.557912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-84eee831-2357-4061-8f93-fcf1ae76f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:29.649644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32270f-fb5c-4adc-82f3-e2ff01fb71c4 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:29.694748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:29.694748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:29.694748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:29.694748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] PATH_INFO: `/v3/projects/7fff672f063547ed8343cdfb02e18e3f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:29.705006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fff672f063547ed8343cdfb02e18e3f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:29.715154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:29.834336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 882/1746] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:29.848421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:29.848732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:29.849031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:29.912352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] MFA Rules not processed for user `d648eccdff80444f884c1fe56c8abe76`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:29.915997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:29.985779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 883/1747] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:30.011088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fff672f063547ed8343cdfb02e18e3f', 'request_id': 'req-e6472217-6a85-4864-97d5-fac5baa0c9c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.075221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:30.076875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:30.132847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fff672f063547ed8343cdfb02e18e3f', 'request_id': 'req-e6472217-6a85-4864-97d5-fac5baa0c9c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.142088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fff672f063547ed8343cdfb02e18e3f', 'request_id': 'req-e6472217-6a85-4864-97d5-fac5baa0c9c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.185924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] The token cache is being invalidate because project 7fff672f063547ed8343cdfb02e18e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:30.198219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.201318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.211920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 865/1748] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:29 2022] DELETE /identity/v3/projects/7fff672f063547ed8343cdfb02e18e3f => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:30.219279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:30.233778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:30.271527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:30.326361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa126efb-d73f-498c-8c6c-2392620e3216 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:30.411608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472217-6a85-4864-97d5-fac5baa0c9c7 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:30.427361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:30.428843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:30.430144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:30.430669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] PATH_INFO: `/v3/users/189e1dc2129e44368310bae003e838fc` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:30.442386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189e1dc2129e44368310bae003e838fc)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:30.449396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:30.552888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:30.555060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:30.568616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:30.569793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:30.575932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:30.710031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:30.737104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189e1dc2129e44368310bae003e838fc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.738893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189e1dc2129e44368310bae003e838fc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.826906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:30.828763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8cfbf-d795-496d-bcd3-8f2da8d69fcb service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:30.854382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189e1dc2129e44368310bae003e838fc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.871125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 884/1749] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:30.871893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:30.901074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189e1dc2129e44368310bae003e838fc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.927214 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189e1dc2129e44368310bae003e838fc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:30.952700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 866/1750] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:30 2022] DELETE /identity/v3/users/189e1dc2129e44368310bae003e838fc => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:31.849379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2f447-f7b0-4bbc-aacb-98ee72575e73 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:31.852236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2f447-f7b0-4bbc-aacb-98ee72575e73 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:31.852236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2f447-f7b0-4bbc-aacb-98ee72575e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:31.943246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4da2f447-f7b0-4bbc-aacb-98ee72575e73 None None] MFA Rules not processed for user `d04625404c4344bf9d1f11bc14ff69da`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:31.944745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4da2f447-f7b0-4bbc-aacb-98ee72575e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:31.958148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:32.168220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 885/1751] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:32.184053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:32.186084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:32.333760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:32.343358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d2a8-ca12-4fb8-ad24-5ebd313fb7dd None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:32.344076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d2a8-ca12-4fb8-ad24-5ebd313fb7dd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:32.344537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d2a8-ca12-4fb8-ad24-5ebd313fb7dd None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:32.346538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 886/1752] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:56:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:32.359090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:32.359618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:32.360164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:32.396175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f6e6-71d1-4dae-8051-da87cf1d92a5 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:32.415375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:32.418583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:32.419046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:32.419763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:32.444030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:32.448004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:32.453827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:32.455154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:32.480250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 867/1753] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:32.546066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 887/1754] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:32.852549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:32.869421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a916a2-8dbe-41a4-87f5-935f3146cd3b service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:32.895259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:32.895681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:32.895969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:32.896244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:32.935394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:32.936835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148be62-dc18-4d02-a629-d01f7d279888 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:32.994764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 868/1755] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:33.532632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:34.069016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:34.379136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:34.382537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.767437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab271c-e9d4-4631-978e-f16aefa13dfc None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:34.781871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:34.782627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.789990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.789990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] PATH_INFO: `/v3/projects/183d91147e764074b81a8ea0704c1243` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.789990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183d91147e764074b81a8ea0704c1243)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:34.789990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:35.115239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183d91147e764074b81a8ea0704c1243', 'request_id': 'req-4e587336-0794-41c9-9c49-f2aed16d1243'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:35.218069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183d91147e764074b81a8ea0704c1243', 'request_id': 'req-4e587336-0794-41c9-9c49-f2aed16d1243'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:35.228037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183d91147e764074b81a8ea0704c1243', 'request_id': 'req-4e587336-0794-41c9-9c49-f2aed16d1243'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:35.331872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] The token cache is being invalidate because project 183d91147e764074b81a8ea0704c1243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:35.334786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:35.336624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e587336-0794-41c9-9c49-f2aed16d1243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:35.355551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 888/1756] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:34 2022] DELETE /identity/v3/projects/183d91147e764074b81a8ea0704c1243 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:35.358861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.362373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.362373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.446239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:35.459508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:35.524015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:35.779014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:35.797304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.798729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.799159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.804100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 869/1757] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:35.893492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:35.900567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:35.941033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 889/1758] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:35.945354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:35.957762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cab0a-e3fb-45ee-b785-b56eab14b8a1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:35.969327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:35.970979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.971282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.971620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.972383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:35.972755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:35.975116 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.023007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.032080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 870/1759] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:36.033264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003a8e9-a93d-44ca-bfba-de1760966d86 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.057651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.060700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:36.062970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.063610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.067530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.068402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.070012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.077482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.095803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ffad4-6bd7-40d9-9b80-915689160c21 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.111643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.112310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.112592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.112866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] PATH_INFO: `/v3/users/d6ff44b29fdc4568989b6c2bc88bf94e` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.114806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ff44b29fdc4568989b6c2bc88bf94e)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.118122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.326090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 890/1760] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:36 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:36.329418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.466310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ff44b29fdc4568989b6c2bc88bf94e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:36.466310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ff44b29fdc4568989b6c2bc88bf94e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:36.473435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1cbfb-bdea-4773-b27a-b83bcf883a9e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.488286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.488916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.489403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.491318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.496686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.500596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8ba05-b10d-4584-b734-3cb8a293984e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.573648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ff44b29fdc4568989b6c2bc88bf94e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:36.643504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ff44b29fdc4568989b6c2bc88bf94e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:36.673098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ff44b29fdc4568989b6c2bc88bf94e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:36.692417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 871/1761] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:36 2022] DELETE /identity/v3/users/d6ff44b29fdc4568989b6c2bc88bf94e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:36.704505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.706917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 891/1762] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:36 2022] POST /identity/v3/users => generated 290 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:36.707219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:36.708217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.708505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.708864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.841348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:36.842651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.046886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c726-88fa-466a-8edb-9c742105c62c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.050358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 892/1763] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:37.051536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:37.059840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.068650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.069713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.070341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.072432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] PATH_INFO: `/v3/users/ef3ae3776de64fd59c5a2762216be3e0` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.075411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3ae3776de64fd59c5a2762216be3e0)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:37.079656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.103996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc5c9e-7249-416b-88d0-511aa586c317 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.141395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.144419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.146945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.147454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.148728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:37.157915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12a72-86c9-4aaf-8db7-0e9ee823c030 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.212125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 893/1764] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:37.215906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.218131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.218583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.223261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 894/1765] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:56:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:37.224149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:37.233434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.419595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cb253-e4b8-446c-b204-880a2527b234 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.425492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.427010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.427765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.428940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.453624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:37.457277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.471907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:37.481685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3ae3776de64fd59c5a2762216be3e0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.483454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3ae3776de64fd59c5a2762216be3e0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.520837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 895/1766] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:37.526757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:37.544578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6a952-4749-49af-b245-8abd5ec010c2 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.551323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.554548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.555349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.556001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.558874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:37.560861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c020f-6aaa-478d-a7b3-306d102bc26c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.567113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3ae3776de64fd59c5a2762216be3e0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.585091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 896/1767] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:37.586396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3e63-5a9a-4fe4-ba7e-5afe367c9afb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.587259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3e63-5a9a-4fe4-ba7e-5afe367c9afb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.588166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3e63-5a9a-4fe4-ba7e-5afe367c9afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.603795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3ae3776de64fd59c5a2762216be3e0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.626291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3ae3776de64fd59c5a2762216be3e0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.640025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 872/1768] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:36 2022] DELETE /identity/v3/users/ef3ae3776de64fd59c5a2762216be3e0 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:37.644331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:37.651638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.687818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9bcf3e63-5a9a-4fe4-ba7e-5afe367c9afb None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:37.694247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9bcf3e63-5a9a-4fe4-ba7e-5afe367c9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.933292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c54d1-55e6-41b2-a5ca-6fce5ee2a2dd admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.939205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 897/1769] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:37.941217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.941779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.942313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.956855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.957993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.961700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.975193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] PATH_INFO: `/v3/projects/b60b8c2b7f2b42d1ac0477a1abdd2ee5/users/1d96c0ec06aa48d8b589019960ccd2ec/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.039841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:38.048747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.064583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60b8c2b7f2b42d1ac0477a1abdd2ee5, user_id=1d96c0ec06aa48d8b589019960ccd2ec, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:38.080037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:38.087180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 898/1770] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:38.095254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:38.097404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.178064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 873/1771] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:37 2022] PUT /identity/v3/projects/b60b8c2b7f2b42d1ac0477a1abdd2ee5/users/1d96c0ec06aa48d8b589019960ccd2ec/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:38.179041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:38.188431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.288571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe4ba-9190-46ed-8d5d-e785df9a93e8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:38.425051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:38.434160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06c444-b9e0-4c49-921f-6c68cbc327f6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:38.441984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:38.443362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:38.443662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:38.443946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.449330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:38.449973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:38.450261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:38.450564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.477748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:38.481272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52570d5-04eb-4faf-b772-8e44d78421e8 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:38.532616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 874/1772] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:38.535495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413b6c-3e9a-4b34-ba2b-439f45425233 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:38.538025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413b6c-3e9a-4b34-ba2b-439f45425233 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:38.538594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413b6c-3e9a-4b34-ba2b-439f45425233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.583056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:38.651534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:38.651924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-86413b6c-3e9a-4b34-ba2b-439f45425233 None None] MFA Rules not processed for user `1d96c0ec06aa48d8b589019960ccd2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:38.653244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-86413b6c-3e9a-4b34-ba2b-439f45425233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.655026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:38.688562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 899/1773] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:38.859390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 875/1774] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:38.866037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:38.900832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54fbb-eadd-40d7-9b31-5edc978b27f0 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:38.932573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:38.933984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:38.934425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:38.934892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.936648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:38.940665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:39.049257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.049675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.050086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.105488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] MFA Rules not processed for user `613c1453a9794052a79a51c79d0ad8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:39.120451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:39.136426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 900/1775] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:38 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:39.140456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.221874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 876/1776] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:39.288601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:39.332019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb0ce6-ebea-47d4-b3dc-4f52ccfe7c16 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:39.340339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:39.341171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.341699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.342253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.343241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:39.345564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:39.471811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.478762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 901/1777] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:39 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:39.505486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8da2-4d8d-419e-922f-5f2a1acc0210 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:39.524990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:39.526876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.528562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.529336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.530493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:39.532314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:39.546395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 877/1778] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:39.555476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.568619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91a91-becd-42ab-9189-3e8b2dd7436e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:39.574771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:39.575657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.576261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.576703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] PATH_INFO: `/v3/projects/8f1124a6650b47ce97ae6e45609d8e80/users/ea5b6f0d96e1422c8749c149a9e971a7/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.652055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1124a6650b47ce97ae6e45609d8e80, user_id=ea5b6f0d96e1422c8749c149a9e971a7, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:39.662400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:39.758279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 902/1779] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:39 2022] PUT /identity/v3/projects/8f1124a6650b47ce97ae6e45609d8e80/users/ea5b6f0d96e1422c8749c149a9e971a7/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:39.762421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.810279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08cede-2a7e-4151-bf9b-eace67a3821f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:39.982061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.985845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:39.986791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:39.992392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.993579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.994000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.994842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.004744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.028532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2018-1fa9-4022-bf73-4e67fecd545c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.049047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.049768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.050060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.050343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] PATH_INFO: `/v3/projects/4e3347af766545398c9fa3a8f4708be8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.056339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 878/1780] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:40.058047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.059789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3347af766545398c9fa3a8f4708be8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.062636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.113954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65474081-80f8-4bd4-aaf2-cce35faf7a11 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.124964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.126020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.126529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.126902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] PATH_INFO: `/v3/projects/8f1124a6650b47ce97ae6e45609d8e80/users/ea5b6f0d96e1422c8749c149a9e971a7/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.128987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1124a6650b47ce97ae6e45609d8e80, user_id=ea5b6f0d96e1422c8749c149a9e971a7, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.133865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1048c5-155f-4e89-8137-da58f5b7e6f9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.153653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 879/1781] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:40 2022] PUT /identity/v3/projects/8f1124a6650b47ce97ae6e45609d8e80/users/ea5b6f0d96e1422c8749c149a9e971a7/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:40.175957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.177142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.177821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.228486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3347af766545398c9fa3a8f4708be8', 'request_id': 'req-434210a8-1dc7-49ff-bda6-df3b435700d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.272891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] MFA Rules not processed for user `ea5b6f0d96e1422c8749c149a9e971a7`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:40.280988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.311933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3347af766545398c9fa3a8f4708be8', 'request_id': 'req-434210a8-1dc7-49ff-bda6-df3b435700d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.335884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3347af766545398c9fa3a8f4708be8', 'request_id': 'req-434210a8-1dc7-49ff-bda6-df3b435700d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.389836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] The token cache is being invalidate because project 4e3347af766545398c9fa3a8f4708be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:40.390171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.395344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-434210a8-1dc7-49ff-bda6-df3b435700d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.406903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 903/1782] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:39 2022] DELETE /identity/v3/projects/4e3347af766545398c9fa3a8f4708be8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:40.410682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.411334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.413893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.477256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:40.481831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.499609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:40.570787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 880/1783] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:40.572219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.578080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.716298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 904/1784] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:40.718889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.726593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.852975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf296f-6669-440c-b009-99f008ec48e1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.853999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:40.883837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.884537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.884889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.885186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] PATH_INFO: `/v3/projects/2c4f5792627b47e49e13203cc30f9146` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.896746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4f5792627b47e49e13203cc30f9146)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.898793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.980238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:41.019247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8583d9-af14-4ffc-a960-306158a0873b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.029722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.030805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.031400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.037886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.063851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.067083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83ce7-2263-47fc-ae8f-4ffd6c0d54bc service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.105348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 905/1785] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:41.107532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.113285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.113285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.167777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:41.169687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:41.187400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4f5792627b47e49e13203cc30f9146', 'request_id': 'req-c4b2404d-44b0-4796-8cbc-485dcf027398'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.236314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:41.271919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4f5792627b47e49e13203cc30f9146', 'request_id': 'req-c4b2404d-44b0-4796-8cbc-485dcf027398'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.288095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4f5792627b47e49e13203cc30f9146', 'request_id': 'req-c4b2404d-44b0-4796-8cbc-485dcf027398'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.299009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 906/1786] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:41.304275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.326133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] The token cache is being invalidate because project 2c4f5792627b47e49e13203cc30f9146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:41.326436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.331698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddef94-2ffb-472f-8851-72bc01d357c5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.331786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.334109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 881/1787] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:40 2022] DELETE /identity/v3/projects/2c4f5792627b47e49e13203cc30f9146 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:41.340212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:41.342483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.349847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.350586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.350873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.351192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.351857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:41.353687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.355488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:41.355603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.410719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 907/1788] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:41.414409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2404d-44b0-4796-8cbc-485dcf027398 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.416049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.422047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:41.424169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:41.454085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.454797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.455089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.455368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] PATH_INFO: `/v3/users/d07b85f2d123424cad477b2087f8bc3e` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.464356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07b85f2d123424cad477b2087f8bc3e)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.466339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.490361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810971-703e-4376-9a77-a7beea629b48 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.501077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.502261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.503041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.504380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.507629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.510072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.736614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 908/1789] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/projects => generated 371 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:41.747119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.766101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07b85f2d123424cad477b2087f8bc3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.770078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07b85f2d123424cad477b2087f8bc3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.910717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07b85f2d123424cad477b2087f8bc3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.942541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0364b4-ba2e-46d1-a7a7-356d9d5292be admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.949201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07b85f2d123424cad477b2087f8bc3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:41.951784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.952690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.952984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.953485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.954490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.957911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.978221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07b85f2d123424cad477b2087f8bc3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.021436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 882/1790] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:41 2022] DELETE /identity/v3/users/d07b85f2d123424cad477b2087f8bc3e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:42.063089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 909/1791] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:42.068450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.071161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.197065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e887-eb72-41c1-999e-5b7339408a87 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.207748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.208984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.209394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.209750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.210761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.213369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.227341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 883/1792] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:42.231450 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.247818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b940-3209-42cf-a66d-18995e2f58e6 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.256542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.257821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.258171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.258580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.261145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.263356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.281549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 910/1793] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:42.294915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.311132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7579d1-1999-4408-a68b-90353dd15190 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.346082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.346082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.346082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.346082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] PATH_INFO: `/v3/projects/dfbb83dbf5ff494499059002382cc22a/users/2dca2cdcebc74d92b3d7ac63efe620df/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.363650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.374950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.401075 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf89f2-d80c-4843-baa7-04bd1ff4f1f4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.407537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbb83dbf5ff494499059002382cc22a, user_id=2dca2cdcebc74d92b3d7ac63efe620df, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.412681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.412681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.416153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.416699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] PATH_INFO: `/v3/users/1d96c0ec06aa48d8b589019960ccd2ec` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.417334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38258f59-4fcf-44dc-99ec-76dc970dc94e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.421006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d96c0ec06aa48d8b589019960ccd2ec)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.429769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.497268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 884/1794] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:42 2022] PUT /identity/v3/projects/dfbb83dbf5ff494499059002382cc22a/users/2dca2cdcebc74d92b3d7ac63efe620df/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:42.525282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed8a3-eee0-49c0-bca0-02a6c961216e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.532271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed8a3-eee0-49c0-bca0-02a6c961216e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.532913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed8a3-eee0-49c0-bca0-02a6c961216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.610275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-261ed8a3-eee0-49c0-bca0-02a6c961216e None None] MFA Rules not processed for user `2dca2cdcebc74d92b3d7ac63efe620df`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:42.615366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-261ed8a3-eee0-49c0-bca0-02a6c961216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.623884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:42.693658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d96c0ec06aa48d8b589019960ccd2ec'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.741654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:42.744910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d96c0ec06aa48d8b589019960ccd2ec'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.746019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d96c0ec06aa48d8b589019960ccd2ec'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.756845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d96c0ec06aa48d8b589019960ccd2ec'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.805144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 885/1795] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:42.806838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005fc1-87f0-491f-a3b6-24b1182840b5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.807276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005fc1-87f0-491f-a3b6-24b1182840b5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.808365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005fc1-87f0-491f-a3b6-24b1182840b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.852928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d96c0ec06aa48d8b589019960ccd2ec'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:42.863170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8e005fc1-87f0-491f-a3b6-24b1182840b5 None None] MFA Rules not processed for user `d04625404c4344bf9d1f11bc14ff69da`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:42.869988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8e005fc1-87f0-491f-a3b6-24b1182840b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.884040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 911/1796] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:42 2022] DELETE /identity/v3/users/1d96c0ec06aa48d8b589019960ccd2ec => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:42.884040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.887790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.049110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85622-d9e5-4ae8-883a-da3766acd3e7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.056556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 886/1797] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:43.058319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.062829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.062829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.065975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.066645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.066934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.067208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.079988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.079988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.097476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:43.099852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.120758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 887/1798] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:43.161901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.164299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.254836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 912/1799] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:42 2022] POST /identity/v3/projects => generated 371 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:43.261362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.404449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0e9d-00e3-4d9c-9605-753c88f734b1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.458867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f74c-82a0-415d-b0fe-77bdabdc48eb admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.472712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.473371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.474778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.475062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.476844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.481526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.524665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.525315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.525642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.526348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.543666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.546089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.563691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 888/1800] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:43.598073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 913/1801] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:43 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:43.605592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.624602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d037c0-641f-49c7-b46c-1eeb7f03780f service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.630948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.631856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.633508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.655199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.657076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.665117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.692725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 889/1802] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:43.698375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.713924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded08b8-b193-4829-a317-85351ce9cf16 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.721828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.722857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.725297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.725297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] PATH_INFO: `/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d/users/fc72a14b5c064cd6853659150bff934c/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.734002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.741670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.780342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f0af-efd7-40c5-b9fd-c354cb08733f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.797826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5f8f4ef9974508a82dea05c6dc934d, user_id=fc72a14b5c064cd6853659150bff934c, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.801322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.803636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.805315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.805499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.805983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] PATH_INFO: `/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.809076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c045c0fa94a9430399d9722a0bb9fa3f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.813296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.904930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 914/1803] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:43 2022] PUT /identity/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d/users/fc72a14b5c064cd6853659150bff934c/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:43.909639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.022142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c045c0fa94a9430399d9722a0bb9fa3f', 'request_id': 'req-d57d5c10-9b14-4587-98fd-6f77498ef966'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.113981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c045c0fa94a9430399d9722a0bb9fa3f', 'request_id': 'req-d57d5c10-9b14-4587-98fd-6f77498ef966'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.127069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c045c0fa94a9430399d9722a0bb9fa3f', 'request_id': 'req-d57d5c10-9b14-4587-98fd-6f77498ef966'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.150323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:44.151623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2c74-6973-428d-be21-55c6587a0ed1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.172303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] The token cache is being invalidate because project c045c0fa94a9430399d9722a0bb9fa3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:44.172665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.178949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d57d5c10-9b14-4587-98fd-6f77498ef966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.181610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 890/1804] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:43 2022] DELETE /identity/v3/projects/c045c0fa94a9430399d9722a0bb9fa3f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:44.184606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49361-64aa-420c-954e-9771371f1a31 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.184904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49361-64aa-420c-954e-9771371f1a31 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.185179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49361-64aa-420c-954e-9771371f1a31 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.186776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 891/1805] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 30 14:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:44.197760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41cc69-bdfc-42e6-b92c-f742d4d50381 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.202607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41cc69-bdfc-42e6-b92c-f742d4d50381 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.203043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41cc69-bdfc-42e6-b92c-f742d4d50381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.237068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-af41cc69-bdfc-42e6-b92c-f742d4d50381 None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:44.238662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-af41cc69-bdfc-42e6-b92c-f742d4d50381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.247441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.248683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.248973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.249250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.249984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.252050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ec7f9-5abf-4b83-a38d-d181e07ca0e8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.266123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 915/1806] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:44.267864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.268186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.273241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.302399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:44.303097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.316578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 916/1807] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:44.321377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.326389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:44.328637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.357094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de207a-f826-4599-ae79-dcb7ae674d6c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.372975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.373920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.374209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.374515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] PATH_INFO: `/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d/users/fc72a14b5c064cd6853659150bff934c/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.380953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 892/1808] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:44.380953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88505da-d446-494b-b002-3bf4227e619a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.380953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88505da-d446-494b-b002-3bf4227e619a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.381197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5f8f4ef9974508a82dea05c6dc934d, user_id=fc72a14b5c064cd6853659150bff934c, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.381269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88505da-d446-494b-b002-3bf4227e619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.383264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b19c7-f459-479c-b053-14dbb72c464e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.408618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f88505da-d446-494b-b002-3bf4227e619a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:44.410274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f88505da-d446-494b-b002-3bf4227e619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.418757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 917/1809] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:44 2022] PUT /identity/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d/users/fc72a14b5c064cd6853659150bff934c/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:44.427360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.427651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.428024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.488599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] MFA Rules not processed for user `fc72a14b5c064cd6853659150bff934c`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:44.489858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.585919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 893/1810] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:44.587825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88505da-d446-494b-b002-3bf4227e619a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.591127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f88505da-d446-494b-b002-3bf4227e619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.616210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 918/1811] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:44.617693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.629631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e8eeb-2305-46e5-b28a-3520f7587470 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.650831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.650831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.650831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.650831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.651417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:44.651417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.651417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.657308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 919/1812] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:44.658299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.662644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:44.668280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88505da-d446-494b-b002-3bf4227e619a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.672847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.673468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.674188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.674188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.683582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.685470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.717348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 894/1813] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:44.718778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.750843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6f2d-0a27-41df-989d-a53ef3e15457 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.759208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.770671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.770671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.770671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.770671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.770671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.789174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5595f-543d-4e24-a4b5-c004e83725d3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.794415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.795159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.795459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.795722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.807806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.809511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.824176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 920/1814] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:45.064538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.069085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.081960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634b645-ec82-497c-bb38-dee7c14732eb service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.087063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.087682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.087971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.088251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] PATH_INFO: `/v3/projects/b60b8c2b7f2b42d1ac0477a1abdd2ee5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.089631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60b8c2b7f2b42d1ac0477a1abdd2ee5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.131487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 895/1815] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:44 2022] POST /identity/v3/projects => generated 387 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:45.131487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.132265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.184677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:45.237555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa760-2024-4472-819a-11104e691bcd admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.243627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.244370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.244723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.245068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.251467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.256852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.318830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60b8c2b7f2b42d1ac0477a1abdd2ee5', 'request_id': 'req-091df3db-2542-4a37-8cba-d5ad89706cd4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.351358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 896/1816] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:45 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:45.355661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.372594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c01-a825-417e-949d-f18fc7ef845a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.384425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60b8c2b7f2b42d1ac0477a1abdd2ee5', 'request_id': 'req-091df3db-2542-4a37-8cba-d5ad89706cd4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.393431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60b8c2b7f2b42d1ac0477a1abdd2ee5', 'request_id': 'req-091df3db-2542-4a37-8cba-d5ad89706cd4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.434213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] The token cache is being invalidate because project b60b8c2b7f2b42d1ac0477a1abdd2ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:45.434589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.435311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.437155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 921/1817] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:45 2022] DELETE /identity/v3/projects/b60b8c2b7f2b42d1ac0477a1abdd2ee5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:45.440909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.442300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.520767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df3db-2542-4a37-8cba-d5ad89706cd4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.525868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.526605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.526892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.527171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] PATH_INFO: `/v3/users/ea5b6f0d96e1422c8749c149a9e971a7` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.528383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5b6f0d96e1422c8749c149a9e971a7)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.528963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.530486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.530605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.530905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.531291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.532389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.534365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.568469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 897/1818] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:45.577851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.581946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.595002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4532-ac24-45d5-bf31-20355f72c424 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.601362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.603592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.603592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.603592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.603592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.604799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.628350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 898/1819] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:45.638418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.650976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269dc6c-f3d4-452e-91b3-bdc043498ab9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.663385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.663791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.664189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.664471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] PATH_INFO: `/v3/projects/13fafecd36a5488ab828df8d12e090bc/users/441b69ac7f404baba734bb5241526bd2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.684247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fafecd36a5488ab828df8d12e090bc, user_id=441b69ac7f404baba734bb5241526bd2, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.687400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f7769-4e9b-49b9-8d26-bc4fc74eb5bb admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.762984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5b6f0d96e1422c8749c149a9e971a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.774893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5b6f0d96e1422c8749c149a9e971a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.775559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5b6f0d96e1422c8749c149a9e971a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.776157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5b6f0d96e1422c8749c149a9e971a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.830285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 899/1820] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:45 2022] PUT /identity/v3/projects/13fafecd36a5488ab828df8d12e090bc/users/441b69ac7f404baba734bb5241526bd2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:45.839831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.840126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.840432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.847246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5b6f0d96e1422c8749c149a9e971a7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.866978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 922/1821] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:45 2022] DELETE /identity/v3/users/ea5b6f0d96e1422c8749c149a9e971a7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:45.875654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] MFA Rules not processed for user `441b69ac7f404baba734bb5241526bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:45.876890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.945340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 900/1822] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:45.949920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.951332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.026590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71e4f-dbf4-45e9-904b-432df4a8274e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.032082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.032711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.033197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.033485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.034641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.038885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.170286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 923/1823] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:46.171244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.184660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586135c-71f6-420d-ac45-5bac4f6793b5 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.253529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.255893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.256598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.259120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.259120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.259120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.259120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.260531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.273293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886b2e-aa07-4989-b7c5-e9612bd207a3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.278304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.279333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.279926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.280780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] PATH_INFO: `/v3/users/2dca2cdcebc74d92b3d7ac63efe620df` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.282296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dca2cdcebc74d92b3d7ac63efe620df)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.284476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.377243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 901/1824] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:46.378122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.379718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.392403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a519d8-392a-4c57-91f4-194275023653 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.398022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.398974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.398974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.399279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] PATH_INFO: `/v3/projects/8f1124a6650b47ce97ae6e45609d8e80` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.400362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1124a6650b47ce97ae6e45609d8e80)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.402301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.520346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dca2cdcebc74d92b3d7ac63efe620df'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.534336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dca2cdcebc74d92b3d7ac63efe620df'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.535175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dca2cdcebc74d92b3d7ac63efe620df'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.536091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dca2cdcebc74d92b3d7ac63efe620df'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.552629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1124a6650b47ce97ae6e45609d8e80', 'request_id': 'req-14471a26-c802-464c-931a-b071ae179c94'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.660905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dca2cdcebc74d92b3d7ac63efe620df'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.679377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 924/1825] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:46 2022] DELETE /identity/v3/users/2dca2cdcebc74d92b3d7ac63efe620df => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:46.681094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.682616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.714095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1124a6650b47ce97ae6e45609d8e80', 'request_id': 'req-14471a26-c802-464c-931a-b071ae179c94'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.723173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1124a6650b47ce97ae6e45609d8e80', 'request_id': 'req-14471a26-c802-464c-931a-b071ae179c94'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.736700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] The token cache is being invalidate because project 8f1124a6650b47ce97ae6e45609d8e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:46.736996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.737877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-14471a26-c802-464c-931a-b071ae179c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.740062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 902/1826] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:46 2022] DELETE /identity/v3/projects/8f1124a6650b47ce97ae6e45609d8e80 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:46.741774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4501-c979-4d63-968a-fcf8cfa4f080 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.742314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4501-c979-4d63-968a-fcf8cfa4f080 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.742800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4501-c979-4d63-968a-fcf8cfa4f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.760350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab825-0ff4-44dc-8fa5-56a4cc4eb545 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.764232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-7fbc4501-c979-4d63-968a-fcf8cfa4f080 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:46.765239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.765588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7fbc4501-c979-4d63-968a-fcf8cfa4f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.765876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.766138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.766404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.767084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.768659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.776828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 903/1827] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:46.776828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.776828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.776828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.794879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 925/1828] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:46.795851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.797568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.798394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:46.799937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.809143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 904/1829] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:46.811376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.812797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.827383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bde671-1315-4875-94c9-4fe5090d5b2e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.834128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.834869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.835271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.835557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] PATH_INFO: `/v3/projects/ca0f2b6bb5084cc58f92449e62431732/users/c3d1f039fdbd40e0b5ba7483d556b343/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.850738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0f2b6bb5084cc58f92449e62431732, user_id=c3d1f039fdbd40e0b5ba7483d556b343, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.853403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.866530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917aa0-530b-4807-a624-468801d87c3c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.872118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.872118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.872118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.872118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.881806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.883301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051d44b-d5b0-468b-998a-e747acbc6afc service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.895478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 926/1830] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:46.895478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.895478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.895478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.919306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:46.924570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.924764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 905/1831] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:46 2022] PUT /identity/v3/projects/ca0f2b6bb5084cc58f92449e62431732/users/c3d1f039fdbd40e0b5ba7483d556b343/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:46.924764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.992716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 927/1832] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:46.993604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.996050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087675d-8ab4-4fbf-9850-907b55e11851 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.001108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.001726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.002009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.002281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.002963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.003179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38063941-ec47-4127-9611-f9cb7d45b7d3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.004558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.007918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.012759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.014763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 906/1833] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:47.018737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.029636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 928/1834] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:47.029815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265222ba-42db-4775-bfda-aaa116635a7a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.030609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.033262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.033916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.034228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.034576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] PATH_INFO: `/v3/projects/ca0f2b6bb5084cc58f92449e62431732/users/c3d1f039fdbd40e0b5ba7483d556b343/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.037227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0f2b6bb5084cc58f92449e62431732, user_id=c3d1f039fdbd40e0b5ba7483d556b343, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.039973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323ca2-e548-4419-947f-cc48f88248d8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.050124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7111a-97dc-4f4f-b2d3-4378ba6caa1d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.050124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.050124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.050124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.050624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.050624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.050782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.051065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 907/1835] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:47 2022] PUT /identity/v3/projects/ca0f2b6bb5084cc58f92449e62431732/users/c3d1f039fdbd40e0b5ba7483d556b343/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:47.063109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.063464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.063808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.093611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] MFA Rules not processed for user `c3d1f039fdbd40e0b5ba7483d556b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:47.095037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.176045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 908/1836] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:47.182664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 929/1837] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:47.183723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.189142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.191051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.266031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a32a-1760-491c-988b-bc71b23bfb83 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.270041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.271176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.271521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.271798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.280648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f809da-8817-4c1d-8391-cf81a21e3b4c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.336233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.337835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.349525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 930/1838] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:47.351829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.352808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.353105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.353382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.354275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.356004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:47.358144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.368829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.370465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.386133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0726-7877-4127-a65c-fc0728f3b447 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.392690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.393548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.394052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.394461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] PATH_INFO: `/v3/projects/dfbb83dbf5ff494499059002382cc22a` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.396890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbb83dbf5ff494499059002382cc22a)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.400498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.470333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 909/1839] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:47.471293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.481770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec211052-3b78-414f-a71e-dd65a5231b8e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.486439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.487101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.487386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.487661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] PATH_INFO: `/v3/users/441b69ac7f404baba734bb5241526bd2` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.490340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=441b69ac7f404baba734bb5241526bd2)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.491063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.540941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbb83dbf5ff494499059002382cc22a', 'request_id': 'req-39468006-4a8b-4672-8d18-85b9266df931'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.639270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbb83dbf5ff494499059002382cc22a', 'request_id': 'req-39468006-4a8b-4672-8d18-85b9266df931'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.646062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbb83dbf5ff494499059002382cc22a', 'request_id': 'req-39468006-4a8b-4672-8d18-85b9266df931'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.657947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] The token cache is being invalidate because project dfbb83dbf5ff494499059002382cc22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:47.658244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.658961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.660650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 931/1840] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:47 2022] DELETE /identity/v3/projects/dfbb83dbf5ff494499059002382cc22a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:47.661985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.663407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.717707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441b69ac7f404baba734bb5241526bd2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.718541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441b69ac7f404baba734bb5241526bd2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.738892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468006-4a8b-4672-8d18-85b9266df931 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.744484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.745104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.745409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.745683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.746337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.748062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.763524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 932/1841] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:47.763524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.763524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.782820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a358e9-d6dd-45a0-b6bc-3d5350c0316a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.783531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441b69ac7f404baba734bb5241526bd2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.792295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.792295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.792295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.792295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] PATH_INFO: `/v3/users/fc72a14b5c064cd6853659150bff934c` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.794870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc72a14b5c064cd6853659150bff934c)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.797240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.799844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441b69ac7f404baba734bb5241526bd2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.807719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441b69ac7f404baba734bb5241526bd2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.814130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 910/1842] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:47 2022] DELETE /identity/v3/users/441b69ac7f404baba734bb5241526bd2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:47.815276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.817327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.893058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7062c-34f9-4886-9086-d392ae1fc32c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.897853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.898481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.898769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.899043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.899691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.901380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0955-5822-4a49-822a-e87a0682fb82 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.912062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 911/1843] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:47.913023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.913314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.913589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.932766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:47.933970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.941582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 912/1844] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:47.942343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.951493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a573b9-2251-4158-99ec-f4787f262507 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.956108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.956749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.957033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.957311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] PATH_INFO: `/v3/projects/b07b15ebdb38469eb3fada30a99c54fb/users/3103154c829740f1812e870b7a28e6f0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.972613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07b15ebdb38469eb3fada30a99c54fb, user_id=3103154c829740f1812e870b7a28e6f0, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.975952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.012905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc72a14b5c064cd6853659150bff934c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.024987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc72a14b5c064cd6853659150bff934c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.025648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc72a14b5c064cd6853659150bff934c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.026288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc72a14b5c064cd6853659150bff934c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.028398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:48.056840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 913/1845] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:47 2022] PUT /identity/v3/projects/b07b15ebdb38469eb3fada30a99c54fb/users/3103154c829740f1812e870b7a28e6f0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:48.057763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.059370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.116379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a8c8-a500-4af6-8154-53ba9e4b9992 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.120029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.123661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.123661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.123661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.123661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.152363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-df3a8e6b-0196-4de9-bff4-b456797f60e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc72a14b5c064cd6853659150bff934c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.165519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 933/1846] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:47 2022] DELETE /identity/v3/users/fc72a14b5c064cd6853659150bff934c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:48.170013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.170317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.170628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.193589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:48.195025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.205240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.206709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.217990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 914/1847] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:48.266480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 934/1848] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:48.281492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.282937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.312283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70d10-5c8e-47a9-991c-5f6f48441237 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.382986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.383952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.384284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.384557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.397137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.398800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7b19-3446-45a8-baee-285148996cef service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.409368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 915/1849] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:48.769050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.771235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.784841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7245c-5b2d-4221-b42c-d3af62aea311 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.791770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.792712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.793918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.794405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] PATH_INFO: `/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.795884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5f8f4ef9974508a82dea05c6dc934d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.799016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.976674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5f8f4ef9974508a82dea05c6dc934d', 'request_id': 'req-9c88f860-ea06-46ce-832a-986e553c5916'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:48.982932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:49.092765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5f8f4ef9974508a82dea05c6dc934d', 'request_id': 'req-9c88f860-ea06-46ce-832a-986e553c5916'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.112125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5f8f4ef9974508a82dea05c6dc934d', 'request_id': 'req-9c88f860-ea06-46ce-832a-986e553c5916'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.137946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] The token cache is being invalidate because project 3f5f8f4ef9974508a82dea05c6dc934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:49.137946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.137946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9c88f860-ea06-46ce-832a-986e553c5916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.143455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 935/1850] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:48 2022] DELETE /identity/v3/projects/3f5f8f4ef9974508a82dea05c6dc934d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:49.146027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.146416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.146719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.201164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:49.203861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.310980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 916/1851] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:49.318340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.319258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.319258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.346025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.346480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:49.347531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.348896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.360029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 936/1852] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:49.364043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.372552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2080-6b91-4f47-b409-d7b97f3c069a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.376044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af8a3-5e71-47d0-af8f-54c6301d4312 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.381891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.382006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.382411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.382671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.382771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.382954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.383050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.383229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] PATH_INFO: `/v3/projects/13fafecd36a5488ab828df8d12e090bc` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.383629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:49.383972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.384624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fafecd36a5488ab828df8d12e090bc)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.385805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.397508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.398976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 937/1853] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:49.403556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.416710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efb47-834d-449b-9fe9-53cb66984874 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.427196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.427196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.427196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.427196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.427584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.427893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.545000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 938/1854] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:49.546801 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.550664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fafecd36a5488ab828df8d12e090bc', 'request_id': 'req-4f3b45c4-ee36-410b-b94b-aacc36bc5625'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.622710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0e3b-be36-46a6-951f-f01c2127bbb3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.627648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.628282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.628573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.628854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.629773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.632003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.684749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fafecd36a5488ab828df8d12e090bc', 'request_id': 'req-4f3b45c4-ee36-410b-b94b-aacc36bc5625'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.691866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fafecd36a5488ab828df8d12e090bc', 'request_id': 'req-4f3b45c4-ee36-410b-b94b-aacc36bc5625'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.703394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] The token cache is being invalidate because project 13fafecd36a5488ab828df8d12e090bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:49.703948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.704700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.706704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 917/1855] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:49 2022] DELETE /identity/v3/projects/13fafecd36a5488ab828df8d12e090bc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:49.710976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.712444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.749916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 939/1856] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:49 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:49.751319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.753701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.766812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc6a07-27fe-403e-b028-135072dae8db admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.772560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.773176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.773459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.773733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.774464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.776034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.785176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b45c4-ee36-410b-b94b-aacc36bc5625 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.788244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 940/1857] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:49.791503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.792313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.798728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.798728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.798728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] PATH_INFO: `/v3/users/c3d1f039fdbd40e0b5ba7483d556b343` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.798728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d1f039fdbd40e0b5ba7483d556b343)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.798728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.803446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f9ce-1a9c-499e-816a-275610ca2107 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.808635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.809257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.809572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.809849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.811192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.812804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.830480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 941/1858] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:49.835315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.846383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fecb-a791-4285-a69b-7aae3a8e470c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.853016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.853804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.854264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.854637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] PATH_INFO: `/v3/projects/8ae6c8b0bc644f09a2767dd66e88fd71/users/323f7875d64f4effaaaef564959b52c4/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.875192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae6c8b0bc644f09a2767dd66e88fd71, user_id=323f7875d64f4effaaaef564959b52c4, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.878195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4fb4a-68b0-4466-b556-34136b8692bb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.939432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:50.556518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 942/1859] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:49 2022] PUT /identity/v3/projects/8ae6c8b0bc644f09a2767dd66e88fd71/users/323f7875d64f4effaaaef564959b52c4/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:50.567885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:50.568165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:50.568465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:50.596152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] MFA Rules not processed for user `323f7875d64f4effaaaef564959b52c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:50.597345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:50.663888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 943/1860] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:50.668318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:50.737309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcac9e-9777-4c74-a955-8cd6d53e23d9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:50.741909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:50.742546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:50.742830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:50.743103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:50.743737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:50.745636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:50.882064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d1f039fdbd40e0b5ba7483d556b343'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:50.882750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d1f039fdbd40e0b5ba7483d556b343'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:50.941462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 944/1861] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:50 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:50.945831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:50.948721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.016078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d1f039fdbd40e0b5ba7483d556b343'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.037221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d1f039fdbd40e0b5ba7483d556b343'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.052742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0069c12-caa5-458e-a881-647788ba3885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d1f039fdbd40e0b5ba7483d556b343'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.058664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffce0e-fe28-4dc9-b63f-3ed9ae5c2a0f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.065331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.065964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.066249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.066547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.067875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.070157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.070607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 918/1862] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:49 2022] DELETE /identity/v3/users/c3d1f039fdbd40e0b5ba7483d556b343 => generated 0 bytes in 1360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:51.150488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.150488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.150691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.191751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 945/1863] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:50 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:51.196024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.217332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54a5-6caa-479b-a758-d80ec78ee726 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.243776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] MFA Rules not processed for user `3103154c829740f1812e870b7a28e6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:51.245299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.352215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 919/1864] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:51.353389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.354388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.354607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.354932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.359135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.359135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.360339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.363507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.383475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 946/1865] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:51.389403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829237a-8335-4da5-990e-3adf2ede0b0d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.389529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.396763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.406692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.406985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.407270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.407452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6319c5-c27c-490c-ab2f-d8735615e5b9 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.408354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.410635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.417352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.418039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.418320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.418624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] PATH_INFO: `/v3/projects/ae761c6d20b5450e8dec5b04d66947d6/users/1a37f99cb2ce483a994ee46187c5c7bc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.459707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae761c6d20b5450e8dec5b04d66947d6, user_id=1a37f99cb2ce483a994ee46187c5c7bc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.462012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.591353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 920/1866] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:51.595625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.609151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 947/1867] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:51 2022] PUT /identity/v3/projects/ae761c6d20b5450e8dec5b04d66947d6/users/1a37f99cb2ce483a994ee46187c5c7bc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:51.610705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.706521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef6050-af63-495d-a9ae-2c29418224ab admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.712297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.713291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.713645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.714057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.714890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.718886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.734253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 948/1868] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:51.735565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.752014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d983a-0d6d-45c9-9cde-24c1c4eb254c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.759136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.759921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.760226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.760506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] PATH_INFO: `/v3/projects/ae761c6d20b5450e8dec5b04d66947d6/users/1a37f99cb2ce483a994ee46187c5c7bc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.763165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae761c6d20b5450e8dec5b04d66947d6, user_id=1a37f99cb2ce483a994ee46187c5c7bc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.765897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffb0e-07ba-4f37-a3d2-8d10c7b35b82 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.767976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fbe3d-acbf-4642-9844-434c30b64ffd admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.774312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.775641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.776063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.776532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.777190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.780227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.807390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 949/1869] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:51 2022] PUT /identity/v3/projects/ae761c6d20b5450e8dec5b04d66947d6/users/1a37f99cb2ce483a994ee46187c5c7bc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:51.810371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.810941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.811231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.845968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] MFA Rules not processed for user `1a37f99cb2ce483a994ee46187c5c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:51.847385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.907032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 921/1870] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:51.908604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.931969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b4b-6a07-4d57-9417-0077523db81f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.999641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 950/1871] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:52.012721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.015026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.077919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.079466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.080421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.080939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.081839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.084251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.102133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 922/1872] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:52.103510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.128086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d27e-5d88-4be7-90a5-810a0e8da4bf admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.140343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.141882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8363f74-041a-4583-a419-64aae2f5a7e5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.142332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.142734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.143938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] PATH_INFO: `/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919/users/70df5f2459ba4de89d3d607de1cdecf4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.146473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.147092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.147405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.147904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.166600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.168217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.180172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 951/1873] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:52.195840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecf51ad2de14dc790a38cb42f9c6919, user_id=70df5f2459ba4de89d3d607de1cdecf4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.198816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.267718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.271013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.293309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 923/1874] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:52 2022] PUT /identity/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919/users/70df5f2459ba4de89d3d607de1cdecf4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:52.297349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.315804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835b1c-1f45-4c57-a6f9-9bcf4a47cb45 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.437691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8369-0ed0-468f-aaf6-1cfe499b216b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.443910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.444550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.444886 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.445280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.446000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.448492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.461382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 924/1875] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:52.469394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.469394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.469394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.469394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] PATH_INFO: `/v3/projects/ca0f2b6bb5084cc58f92449e62431732` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.472367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.477588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0f2b6bb5084cc58f92449e62431732)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.480000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.492043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b571d-1752-4609-8150-e23cd17199f8 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.502855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.503798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.504299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.504724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] PATH_INFO: `/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919/users/70df5f2459ba4de89d3d607de1cdecf4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.508438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecf51ad2de14dc790a38cb42f9c6919, user_id=70df5f2459ba4de89d3d607de1cdecf4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.512166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.529119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 925/1876] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:52 2022] PUT /identity/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919/users/70df5f2459ba4de89d3d607de1cdecf4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:52.529119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.578674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:52.631424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0f2b6bb5084cc58f92449e62431732', 'request_id': 'req-12595bf8-2d2b-4740-92e1-02830a1297c3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:52.651470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd2289-a957-45a9-a4f0-24506b1fbf5c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.752397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.753629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.755448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.755949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.764144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.805005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0f2b6bb5084cc58f92449e62431732', 'request_id': 'req-12595bf8-2d2b-4740-92e1-02830a1297c3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:52.844672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0f2b6bb5084cc58f92449e62431732', 'request_id': 'req-12595bf8-2d2b-4740-92e1-02830a1297c3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:52.867243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] The token cache is being invalidate because project ca0f2b6bb5084cc58f92449e62431732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:52.867631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:52.868437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-12595bf8-2d2b-4740-92e1-02830a1297c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:52.887254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 952/1877] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:52 2022] DELETE /identity/v3/projects/ca0f2b6bb5084cc58f92449e62431732 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:52.893908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.894208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.894508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.921541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:52.923007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.957620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.960360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fdb97-5cec-4551-bee5-01264c5fae18 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.985117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 926/1878] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:53.010480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 953/1879] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:53.013527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.013820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.014109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.051894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:53.054058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:53.072411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 927/1880] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:53.072499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.087082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce612a97-3535-4e7a-9177-40a5a2861cea None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.108120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.108302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.108694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.108973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.112190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:53.112515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.116496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.159170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 954/1881] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:53.161262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.179646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3eb8e-b004-4c19-96a6-f5abfcc71ec7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.195643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:53.216163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.219605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.225468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.225900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.230905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.241535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.418583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 928/1882] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:53 2022] POST /identity/v3/projects => generated 401 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:53.419345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.439810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827940-4c11-47bc-ab49-512796d3cbbd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.515635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.517042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.517457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.517994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.518942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.522241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.616346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.625555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 955/1883] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:53 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:53.631665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345e9e-0608-474f-ae1e-4118943e5042 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.639278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.640102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.640488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.640865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.641677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.644026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.664055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 929/1884] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:53.669010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.680277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f051a-82e1-4b0d-8b26-0904c2fe474e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.685123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.685951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.686239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.686548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.687246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.688843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30e58-a31e-481c-ab40-558a20cd2fab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.700407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 956/1885] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:53.704901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.724411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf893b-1eff-45c1-a691-4f849598e795 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.730793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.731707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.732224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.732645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] PATH_INFO: `/v3/projects/b2156d4db7954830890a846716229620/users/949090a9a13746c389bc7b72463e4148/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.758715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2156d4db7954830890a846716229620, user_id=949090a9a13746c389bc7b72463e4148, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.762072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.836319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 930/1886] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:53 2022] PUT /identity/v3/projects/b2156d4db7954830890a846716229620/users/949090a9a13746c389bc7b72463e4148/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:53.846508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.846800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.847078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.881288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] MFA Rules not processed for user `949090a9a13746c389bc7b72463e4148`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:53.882647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:53.997228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 957/1887] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:54.001677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.111223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6098e2-5ca5-41d8-887d-ced1835f809c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.123002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.123720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.124007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.126088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.126854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.131104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.260120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 931/1888] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:54 2022] POST /identity/v3/projects => generated 401 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:54.264457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.279002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63113c13-e649-413f-a4d3-4bdf500c3a91 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.356095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.356656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.357042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.357382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.358138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.360488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.453405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 958/1889] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:54 2022] POST /identity/v3/users => generated 307 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:54.458089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.460305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:54.471146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd67a23-3ad6-426d-be84-2f9a8adf36fd admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.477257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.477938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.478182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.478474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.479165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.480839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.489895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:54.497996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 932/1890] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:54.502708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.514025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317daae-3433-4061-83b2-af14c1957d8a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.519111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.520471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.521106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.521553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] PATH_INFO: `/v3/projects/27935e39d26f476b964e0eecde47393e/users/cb71460b1f884efeac25dea3c104d9c4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.543542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27935e39d26f476b964e0eecde47393e, user_id=cb71460b1f884efeac25dea3c104d9c4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.546534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.629576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 959/1891] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:54 2022] PUT /identity/v3/projects/27935e39d26f476b964e0eecde47393e/users/cb71460b1f884efeac25dea3c104d9c4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:54.633720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.648863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c19fa-4ba8-4c7c-ac84-38198608cc39 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.716281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.717031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.717380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.717718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.718433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.720132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a9a8d-59f3-444e-8123-2ef03a6a123c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.740951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 933/1892] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:54.743778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.760874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e32ce-3645-4895-9dc3-e286fb9212c0 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.787073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.787917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.788230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.789395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] PATH_INFO: `/v3/projects/27935e39d26f476b964e0eecde47393e/users/cb71460b1f884efeac25dea3c104d9c4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.791699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27935e39d26f476b964e0eecde47393e, user_id=cb71460b1f884efeac25dea3c104d9c4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.794771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.815443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 960/1893] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:54 2022] PUT /identity/v3/projects/27935e39d26f476b964e0eecde47393e/users/cb71460b1f884efeac25dea3c104d9c4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:54.828269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793e-6586-4498-9ba4-0e1a469150e7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.828269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793e-6586-4498-9ba4-0e1a469150e7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.828269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793e-6586-4498-9ba4-0e1a469150e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.874664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d01b793e-6586-4498-9ba4-0e1a469150e7 None None] MFA Rules not processed for user `cb71460b1f884efeac25dea3c104d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:54.876311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d01b793e-6586-4498-9ba4-0e1a469150e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:54.999114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 934/1894] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:55.007300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:55.009286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.093580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960d1f4-0266-4e02-b9cb-8c75cd75eb7f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:55.099060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:55.099801 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.100566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.101446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.118125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:55.119622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:55.135861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 961/1895] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:55.368265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddfd7-afc5-4b33-879d-60e732b581a5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.368727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddfd7-afc5-4b33-879d-60e732b581a5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.368821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddfd7-afc5-4b33-879d-60e732b581a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.396840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:55.413940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d615966-e07e-41c5-b0af-6561889b161d service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:55.416477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-818ddfd7-afc5-4b33-879d-60e732b581a5 None None] MFA Rules not processed for user `70df5f2459ba4de89d3d607de1cdecf4`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:55.418208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-818ddfd7-afc5-4b33-879d-60e732b581a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.423034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:55.423670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.423951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.424225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.550587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 935/1896] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:55.562542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:55.563292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.563768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.564038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3988c1-e097-4745-9644-65b739ffc588 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:55.564616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.580510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 962/1897] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:55.603995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] MFA Rules not processed for user `3103154c829740f1812e870b7a28e6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:55.605671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.650281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7ea2d-b6df-40b8-9e2c-3fd45bebc570 None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.651001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7ea2d-b6df-40b8-9e2c-3fd45bebc570 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.651494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7ea2d-b6df-40b8-9e2c-3fd45bebc570 None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.653253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 963/1898] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:55.680518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.680813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.681127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.693648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 936/1899] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:55.704928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:55.707986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.708449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:55.709650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.822483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 964/1900] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:55.853395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58456-9b30-48f5-9171-e85385977398 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:55.859364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:55.860056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.860404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.860740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.863015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.877720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:55.880434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:55.891795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 937/1901] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:56.011033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:56.015507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:56.034925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1df75-7675-4ce9-883f-bfdebe8dce1e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:56.042772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:56.043591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:56.044016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:56.052152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:56.055027 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:56.056809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffacac-f07f-456e-bc50-e95cbce50d61 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:56.070266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 965/1902] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:56.590092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:56.728167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:56.730300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:56.857661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cab4-e80b-44e9-b38e-f918b840288a service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:56.866649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:56.866649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:56.866649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:56.869308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] PATH_INFO: `/v3/users/323f7875d64f4effaaaef564959b52c4` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:56.869308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] RBAC: Authorizing `identity:delete_user(user_id=323f7875d64f4effaaaef564959b52c4)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:56.872037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.087302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323f7875d64f4effaaaef564959b52c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.090118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323f7875d64f4effaaaef564959b52c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.164800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323f7875d64f4effaaaef564959b52c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.184574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323f7875d64f4effaaaef564959b52c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.196930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323f7875d64f4effaaaef564959b52c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.206294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 938/1903] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:56 2022] DELETE /identity/v3/users/323f7875d64f4effaaaef564959b52c4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:57.211164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.211636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.212057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.235934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:57.237155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.304772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 966/1904] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:57.313010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.315200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.386226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b88ea-3ae8-49a5-b286-68478f30935c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.391114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.391791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.392080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.392359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.405357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.406927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.418090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 939/1905] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:57.993460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:58.151716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.153795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.167799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8c3f-8021-4c81-8a0b-6d60f83a6ac2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.179313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.179967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.180256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.180535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] PATH_INFO: `/v3/projects/8ae6c8b0bc644f09a2767dd66e88fd71` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.181744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae6c8b0bc644f09a2767dd66e88fd71)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.183728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.346099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae6c8b0bc644f09a2767dd66e88fd71', 'request_id': 'req-333fd124-7529-4699-b388-a32575bcc067'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.444513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae6c8b0bc644f09a2767dd66e88fd71', 'request_id': 'req-333fd124-7529-4699-b388-a32575bcc067'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.451940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae6c8b0bc644f09a2767dd66e88fd71', 'request_id': 'req-333fd124-7529-4699-b388-a32575bcc067'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.462656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] The token cache is being invalidate because project 8ae6c8b0bc644f09a2767dd66e88fd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:58.462980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.463635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.465186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 967/1906] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:58 2022] DELETE /identity/v3/projects/8ae6c8b0bc644f09a2767dd66e88fd71 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:58.469205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.479677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f86d-2399-4d02-94b2-1f55f1b2b694 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.539651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.542591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.542591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.542591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] PATH_INFO: `/v3/users/1a37f99cb2ce483a994ee46187c5c7bc` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.542591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a37f99cb2ce483a994ee46187c5c7bc)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.543938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.865625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a37f99cb2ce483a994ee46187c5c7bc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.866282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a37f99cb2ce483a994ee46187c5c7bc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.940627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a37f99cb2ce483a994ee46187c5c7bc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.958125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a37f99cb2ce483a994ee46187c5c7bc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.966160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-681bbc47-1704-4ceb-aea4-2a773e27d4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a37f99cb2ce483a994ee46187c5c7bc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.972394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 940/1907] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:58 2022] DELETE /identity/v3/users/1a37f99cb2ce483a994ee46187c5c7bc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.548835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.551060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.565693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd124-7529-4699-b388-a32575bcc067 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.681340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.681910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.682196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.682501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] PATH_INFO: `/v3/projects/ae761c6d20b5450e8dec5b04d66947d6` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.683659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae761c6d20b5450e8dec5b04d66947d6)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.685573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.807791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae761c6d20b5450e8dec5b04d66947d6', 'request_id': 'req-f10f8119-5d60-4fb7-943d-4be4ad711fb8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.901508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae761c6d20b5450e8dec5b04d66947d6', 'request_id': 'req-f10f8119-5d60-4fb7-943d-4be4ad711fb8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.908825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae761c6d20b5450e8dec5b04d66947d6', 'request_id': 'req-f10f8119-5d60-4fb7-943d-4be4ad711fb8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.920166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] The token cache is being invalidate because project ae761c6d20b5450e8dec5b04d66947d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:59.920464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.921254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-f10f8119-5d60-4fb7-943d-4be4ad711fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.922799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 968/1908] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:59 2022] DELETE /identity/v3/projects/ae761c6d20b5450e8dec5b04d66947d6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.928568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.929045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.929147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.956409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:59.958079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.039443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 941/1909] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:00.047495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.048129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.048555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.073025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:00.074332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.091360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 969/1910] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:00.099972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.110263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728999-e8c3-4940-8182-4ea4f02dfd22 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.115702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.116500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.116783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.117748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.118406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:00.118753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.120684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.134096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 942/1911] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:00.138527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.149366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee6db-9eb2-408d-98e0-1edcb8ed2864 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.154056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.154706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.154989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.155265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.155906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.157847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.341503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 970/1912] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:00.342844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.354850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c08-8f7a-4f85-857f-84590c13ac5d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.413311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.413921 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.414203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.414502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.415269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.417334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.527013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 943/1913] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:00.531678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.546168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff3d-f721-4641-a9b1-ce3d7ff2c917 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.550681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.552371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.553388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.553676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.554568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.556180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.571223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 971/1914] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:00.572182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.583590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e932a-2de4-412b-8ed0-e6747fc6d209 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.588579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.589273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.589622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.589971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.590663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.592601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46a1b-b24e-4f1f-85c6-41c8c7e75ccd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.605046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 944/1915] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:00.609055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.619999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478b2c-3acc-4348-b268-746741d6e861 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.624636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.625297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.625581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.625858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] PATH_INFO: `/v3/projects/363e07a85eea4c52ac76cbd523195155/users/2daa803be78a44a7ba3a5dbb86f6ced1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.649743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363e07a85eea4c52ac76cbd523195155, user_id=2daa803be78a44a7ba3a5dbb86f6ced1, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.649743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.755268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 972/1916] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:00 2022] PUT /identity/v3/projects/363e07a85eea4c52ac76cbd523195155/users/2daa803be78a44a7ba3a5dbb86f6ced1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:00.766535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.766819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.767142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.795723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] MFA Rules not processed for user `2daa803be78a44a7ba3a5dbb86f6ced1`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:00.796987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.867734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 945/1917] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:00.872558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.943917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:00.950354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821483c1-0bed-45fd-b191-9877f1ffb994 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.955876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.956498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.957607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.958208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.958580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.960538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.055446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:01.110554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 973/1918] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:01.114755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.125708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3bb42-7539-4735-8f12-8224d73ff184 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.192908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.196952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.196952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.196952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.196952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.199637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.330323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 946/1919] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:01.336001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.347316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.347916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a7768-8fc2-4313-93a7-4ecf57f31f62 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.350242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.352602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.353210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.353493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.353764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.354415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.356026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.363342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b77b-58ba-440e-b0be-598748f30f2e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.366693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 974/1920] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:01.370657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.371062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.371702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.371981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.372535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] PATH_INFO: `/v3/users/949090a9a13746c389bc7b72463e4148` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.373673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949090a9a13746c389bc7b72463e4148)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.376005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.391376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bd1-1cd3-444f-8120-dbcd4e15932d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.403500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.404117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.404395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.404665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.405318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.406936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.418159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 975/1921] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:01.422381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.433352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3aba9-88e1-4ef9-a5f3-54ec1116927c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.438609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.439276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.440046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.440046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] PATH_INFO: `/v3/projects/37036d4973d44ea98eb17638329dda83/users/7a71c59cb1664009b481f722bd260ed1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.456314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37036d4973d44ea98eb17638329dda83, user_id=7a71c59cb1664009b481f722bd260ed1, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.463955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ac100-e125-4bc9-af51-b054ec7c1a42 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.546272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 976/1922] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:01 2022] PUT /identity/v3/projects/37036d4973d44ea98eb17638329dda83/users/7a71c59cb1664009b481f722bd260ed1/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.555692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.556309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.556309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.582712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949090a9a13746c389bc7b72463e4148'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.583481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949090a9a13746c389bc7b72463e4148'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.595604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] MFA Rules not processed for user `7a71c59cb1664009b481f722bd260ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.595604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.660095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 977/1923] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:01.664262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.664714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949090a9a13746c389bc7b72463e4148'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.666175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.684542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949090a9a13746c389bc7b72463e4148'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.696720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-25992cae-a3c9-48d5-9f44-04be4b85a1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949090a9a13746c389bc7b72463e4148'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.703675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 947/1924] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:01 2022] DELETE /identity/v3/users/949090a9a13746c389bc7b72463e4148 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.709007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.709369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.709719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.734630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.736046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.762765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85f84b-21e0-47f2-a6b5-e02b6eaad953 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.809374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 948/1925] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:01.819977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.821385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.833196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.836368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.836368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.836368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.836368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.838026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.889954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74da15-0de7-4dc7-9b19-e43412444fcb None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.893743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.895068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.895348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.895615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.904900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.906348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.916539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 949/1926] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:01.952179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 978/1927] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:01.956234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.969111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33a92-1882-4d40-919c-08c2e6899e7c service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.037290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.037807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.038222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.038347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.039053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.041017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.122951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 950/1928] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:02.127053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.139571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee661-a5ab-4c1b-a41a-bc8ba41fff41 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.147739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.148448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.148802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.149174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.149878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.151580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.165113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 979/1929] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:02.170856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.183490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4ec1e-f71d-4bf9-bf30-211febe091b4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.188980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.189867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.190580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.191470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] PATH_INFO: `/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5/users/98273b0e59a349b1b6d190b0f1f99863/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.211473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b0af25ce22415796fd91ed5f9d4fc5, user_id=98273b0e59a349b1b6d190b0f1f99863, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.214352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.289030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 951/1930] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:02 2022] PUT /identity/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5/users/98273b0e59a349b1b6d190b0f1f99863/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:02.294624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.307324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ecd69-7db9-44f3-b4dd-a7c9d4e78816 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.388617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.389239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.389520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.389794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.390439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.392196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.402790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 980/1931] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:02.407126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.418470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb9f2-1c69-4c57-bdd9-b51d9e3e2e48 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.423264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.423958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.424241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.424519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] PATH_INFO: `/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5/users/98273b0e59a349b1b6d190b0f1f99863/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.426982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b0af25ce22415796fd91ed5f9d4fc5, user_id=98273b0e59a349b1b6d190b0f1f99863, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.429743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1cac1-daa8-4386-b224-dc760c2c2cce admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.440471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 952/1932] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:02 2022] PUT /identity/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5/users/98273b0e59a349b1b6d190b0f1f99863/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:02.451706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.452517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.453247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.453547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.453894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.484438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025234-61cd-4001-a887-abb5555cdbc2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.491562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] MFA Rules not processed for user `98273b0e59a349b1b6d190b0f1f99863`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:02.492742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.558254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.570826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.571119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.571397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] PATH_INFO: `/v3/projects/b2156d4db7954830890a846716229620` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.572765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2156d4db7954830890a846716229620)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.574735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.582767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 953/1933] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:02.590795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.592268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.664313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93930d-f2bd-4c56-92d0-3f219e9d70f0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.668452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.670834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.670834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.670834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.673096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.701524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2156d4db7954830890a846716229620', 'request_id': 'req-29011ad4-131d-4e4e-bcde-85326372e53f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.741528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.743112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.753920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 954/1934] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:02.815313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2156d4db7954830890a846716229620', 'request_id': 'req-29011ad4-131d-4e4e-bcde-85326372e53f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.823564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2156d4db7954830890a846716229620', 'request_id': 'req-29011ad4-131d-4e4e-bcde-85326372e53f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.851011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] The token cache is being invalidate because project b2156d4db7954830890a846716229620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:02.851409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.852499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.855980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 981/1935] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:02 2022] DELETE /identity/v3/projects/b2156d4db7954830890a846716229620 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:02.860884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.874881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63206-4277-4a2f-82dc-43c075e23653 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.004546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.005163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.005163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.005470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] PATH_INFO: `/v3/users/cb71460b1f884efeac25dea3c104d9c4` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.006786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb71460b1f884efeac25dea3c104d9c4)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.008849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.259524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb71460b1f884efeac25dea3c104d9c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.260253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb71460b1f884efeac25dea3c104d9c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.331274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb71460b1f884efeac25dea3c104d9c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.358583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb71460b1f884efeac25dea3c104d9c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.374671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-532b0b6d-e095-4a7e-81f7-d0b8b9f6be86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb71460b1f884efeac25dea3c104d9c4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.384017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 955/1936] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:02 2022] DELETE /identity/v3/users/cb71460b1f884efeac25dea3c104d9c4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:04.192025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.193590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.207574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29011ad4-131d-4e4e-bcde-85326372e53f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.271960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.272656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.272949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.273231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] PATH_INFO: `/v3/projects/27935e39d26f476b964e0eecde47393e` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.274405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=27935e39d26f476b964e0eecde47393e)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.276342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.396021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:04.401880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27935e39d26f476b964e0eecde47393e', 'request_id': 'req-fd22f690-9568-4412-bb32-c4f01d17a9be'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.508792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27935e39d26f476b964e0eecde47393e', 'request_id': 'req-fd22f690-9568-4412-bb32-c4f01d17a9be'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.511352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:04.517288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27935e39d26f476b964e0eecde47393e', 'request_id': 'req-fd22f690-9568-4412-bb32-c4f01d17a9be'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.530460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] The token cache is being invalidate because project 27935e39d26f476b964e0eecde47393e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:04.530758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.531425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fd22f690-9568-4412-bb32-c4f01d17a9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.532932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 982/1937] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:04 2022] DELETE /identity/v3/projects/27935e39d26f476b964e0eecde47393e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:04.538837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.539128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.539410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.560240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:04.561451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.632009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 956/1938] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:04.633874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.634173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.634423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.669268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:04.675120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.702958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 983/1939] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:04.711870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.723122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e922-709f-4ed6-bb2c-004942901705 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.729522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.731204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.731686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.732555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.733384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:04.733836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.735804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.749608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 957/1940] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:04.754240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.766163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386df02-7bd6-4f54-a437-868009b8f39d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.773178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.777319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.777319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.777319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.777319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.777319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.858487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 984/1941] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:04.863391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.873474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fd3a-3962-4f0c-bb8f-9f32e44513df admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.934928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.935542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.935983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.942997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.943989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.947203 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.002199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.004796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.064144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0ddf-f9ad-4cb8-b789-6f07dbaa531b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.074760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 958/1942] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:05.076168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.076168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.076168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.076168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.076467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.084770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.098594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c8a74-ded7-4381-8c6c-3ab35f15f30c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.103558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.104181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.104462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.104736 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.105458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.107319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.118292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 959/1943] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:05.122567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.133525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf41b2d-b178-49e0-93f9-7e7b8ee39f67 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.138819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.139655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.139928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.140344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.141129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.142590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.142731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.145258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2122b0-d7f5-47d7-81d4-9d7de4cf38d7 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.157637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 960/1944] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:05.157845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 985/1945] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:05.158874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.170311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1dc3d-9aed-4cad-8f52-dd16143dc242 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.176059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.176668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.177121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.177405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] PATH_INFO: `/v3/projects/c91bc3f8879a4373834b377220bfa985/users/d134379f559549ee9d6e79a244113562/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.193843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91bc3f8879a4373834b377220bfa985, user_id=d134379f559549ee9d6e79a244113562, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.196868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.274487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 961/1946] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:05 2022] PUT /identity/v3/projects/c91bc3f8879a4373834b377220bfa985/users/d134379f559549ee9d6e79a244113562/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:05.285030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.285627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.285627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.323157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] MFA Rules not processed for user `d134379f559549ee9d6e79a244113562`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:05.325070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.424950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 986/1947] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:05.430323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.527850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39d5b-baa6-47ff-b46f-549fdd49695f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.534934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.535576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.536121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.544213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.547448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.552018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.673223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 962/1948] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:05.674483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.686648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddec90-24a4-41e5-ae4f-b148a331a232 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.777240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.778016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.778329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.778709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.779431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.781658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.901777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 987/1949] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:05.906419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.918994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158250ad-677f-4fc5-b37a-4bf8ae13b6e8 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.924453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.927465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.927465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.927465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.927465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.929101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.940517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 963/1950] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:05.945519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.961208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8c8c-663c-4df6-ba55-245efcc77399 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.966038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.966866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.967150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.967738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] PATH_INFO: `/v3/projects/d320700f142f485b8f0629250b330f8f/users/562669426830436d951f514c74ec4663/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.984367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d320700f142f485b8f0629250b330f8f, user_id=562669426830436d951f514c74ec4663, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.987137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.068731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 988/1951] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:05 2022] PUT /identity/v3/projects/d320700f142f485b8f0629250b330f8f/users/562669426830436d951f514c74ec4663/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:06.073523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.086727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7a4a-2a64-4fad-8867-7f3bc5572b81 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.179631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.180382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.180661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.180985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.181644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.184301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21747a17-9260-487c-918e-b441e9c37d4a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.198488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 964/1952] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:06.202553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.214143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ee52-5382-4f15-b9b9-da4e1f0634eb admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.220738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.222105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.222105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.222398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] PATH_INFO: `/v3/projects/d320700f142f485b8f0629250b330f8f/users/562669426830436d951f514c74ec4663/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.225185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d320700f142f485b8f0629250b330f8f, user_id=562669426830436d951f514c74ec4663, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.228143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.241457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 989/1953] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:06 2022] PUT /identity/v3/projects/d320700f142f485b8f0629250b330f8f/users/562669426830436d951f514c74ec4663/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:06.255206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.255500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.255782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.300889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] MFA Rules not processed for user `562669426830436d951f514c74ec4663`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:06.302240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:06.397362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 965/1954] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:06.414926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.417171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:06.475182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ac4e-7a17-4d8b-a533-119470bdadb3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.478849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.479452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.479730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.480000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.515335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:06.537777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.539247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.547908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 990/1955] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:06.938271 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:07.811447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:07.991394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:08.002639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311db37-ea45-480f-a4d0-240841b7af76 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:08.007924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:08.008870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:08.009299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:08.009792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:08.011856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:08.090155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:08.092049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:08.104149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 966/1956] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:08.567010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:09.543216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:10.223859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:11.617967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:11.714158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:12.056587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:12.657543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:13.158202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.161115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.240254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156845-b549-49de-8ac7-e9b17e59bdf6 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.245292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.246632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.247072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.247495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] PATH_INFO: `/v3/users/2daa803be78a44a7ba3a5dbb86f6ced1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.249062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2daa803be78a44a7ba3a5dbb86f6ced1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.251220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.453224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.466511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125f78-191f-44a5-a28e-393c40914784 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.470220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.470873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.471678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.471963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.484891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.486335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86e70f-7a73-42c1-b58c-bf931a5aa277 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.498572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 967/1957] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:13.511503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2daa803be78a44a7ba3a5dbb86f6ced1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.547365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2daa803be78a44a7ba3a5dbb86f6ced1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.548322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2daa803be78a44a7ba3a5dbb86f6ced1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.549284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2daa803be78a44a7ba3a5dbb86f6ced1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.633798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2daa803be78a44a7ba3a5dbb86f6ced1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.651032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 991/1958] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:13 2022] DELETE /identity/v3/users/2daa803be78a44a7ba3a5dbb86f6ced1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:13.652996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.653289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.653571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.677075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:13.678256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.737910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 968/1959] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:13.748231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.749657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.819752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe094a-85c1-45c2-8206-1f11b4f12cb5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.823930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.824582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.824872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.825142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.835470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.836913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.849581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 992/1960] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:14.144502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:14.211447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:14.308459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.310657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:14.327099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb24bb-e378-43b7-b584-b2478a3086e2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.337967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.340170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.340463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.344865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] PATH_INFO: `/v3/projects/363e07a85eea4c52ac76cbd523195155` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.356626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=363e07a85eea4c52ac76cbd523195155)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.363342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.490975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363e07a85eea4c52ac76cbd523195155', 'request_id': 'req-37179b48-9cc5-4d37-be85-d0bc899a1a2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.599598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363e07a85eea4c52ac76cbd523195155', 'request_id': 'req-37179b48-9cc5-4d37-be85-d0bc899a1a2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.606499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363e07a85eea4c52ac76cbd523195155', 'request_id': 'req-37179b48-9cc5-4d37-be85-d0bc899a1a2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.619209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] The token cache is being invalidate because project 363e07a85eea4c52ac76cbd523195155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:14.619503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.620190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.621968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 969/1961] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:14 2022] DELETE /identity/v3/projects/363e07a85eea4c52ac76cbd523195155 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:14.626173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.637358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fda61e-fa12-413e-9749-5b9901b29aec service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.710990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.711834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.711943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.712199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] PATH_INFO: `/v3/users/7a71c59cb1664009b481f722bd260ed1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.713597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a71c59cb1664009b481f722bd260ed1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.715751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.926697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a71c59cb1664009b481f722bd260ed1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.938859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a71c59cb1664009b481f722bd260ed1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.939578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a71c59cb1664009b481f722bd260ed1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:14.940564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a71c59cb1664009b481f722bd260ed1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.039315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a71c59cb1664009b481f722bd260ed1'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.052032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 993/1962] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:14 2022] DELETE /identity/v3/users/7a71c59cb1664009b481f722bd260ed1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:15.544653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.546044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:15.564416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37179b48-9cc5-4d37-be85-d0bc899a1a2e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.680719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.681360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.681639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.681908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] PATH_INFO: `/v3/projects/37036d4973d44ea98eb17638329dda83` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.683071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37036d4973d44ea98eb17638329dda83)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.685030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.842408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37036d4973d44ea98eb17638329dda83', 'request_id': 'req-19b1acc6-61c3-4153-afa0-831645c95f96'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.945783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37036d4973d44ea98eb17638329dda83', 'request_id': 'req-19b1acc6-61c3-4153-afa0-831645c95f96'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.953677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37036d4973d44ea98eb17638329dda83', 'request_id': 'req-19b1acc6-61c3-4153-afa0-831645c95f96'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.966705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] The token cache is being invalidate because project 37036d4973d44ea98eb17638329dda83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:15.966705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.967256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.969182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 970/1963] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:15 2022] DELETE /identity/v3/projects/37036d4973d44ea98eb17638329dda83 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:15.973736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.975274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:15.989200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182435-5644-4be8-9071-4f4a6e8a64d1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.049317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.049945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.050906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.051362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] PATH_INFO: `/v3/users/98273b0e59a349b1b6d190b0f1f99863` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.052499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] RBAC: Authorizing `identity:delete_user(user_id=98273b0e59a349b1b6d190b0f1f99863)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.054419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.569381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:16.716711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98273b0e59a349b1b6d190b0f1f99863'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.729613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98273b0e59a349b1b6d190b0f1f99863'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.730403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98273b0e59a349b1b6d190b0f1f99863'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.731060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98273b0e59a349b1b6d190b0f1f99863'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.739002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:16.822120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-52849b11-05b9-43c2-b052-9f5c5c3155af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98273b0e59a349b1b6d190b0f1f99863'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.836932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 994/1964] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:15 2022] DELETE /identity/v3/users/98273b0e59a349b1b6d190b0f1f99863 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:17.373579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.375490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.390390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1acc6-61c3-4153-afa0-831645c95f96 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.465849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.466559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.466851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.467318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] PATH_INFO: `/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.468471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b0af25ce22415796fd91ed5f9d4fc5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.470569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:17.603341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b0af25ce22415796fd91ed5f9d4fc5', 'request_id': 'req-1f83261a-8f25-4286-b6fd-4a8d46eef43b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.690181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b0af25ce22415796fd91ed5f9d4fc5', 'request_id': 'req-1f83261a-8f25-4286-b6fd-4a8d46eef43b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.697471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b0af25ce22415796fd91ed5f9d4fc5', 'request_id': 'req-1f83261a-8f25-4286-b6fd-4a8d46eef43b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.708983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] The token cache is being invalidate because project 02b0af25ce22415796fd91ed5f9d4fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:17.709550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.710377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1f83261a-8f25-4286-b6fd-4a8d46eef43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.712102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 971/1965] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:17 2022] DELETE /identity/v3/projects/02b0af25ce22415796fd91ed5f9d4fc5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:17.717306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.717798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.717798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.739641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:17.740917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.802536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 995/1966] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:17.810453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.810763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.811147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.832674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:17.834139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.841865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 972/1967] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:17.847423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.857049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa527a6-ab70-4c6b-a2f9-d46f42dba012 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.864131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.864718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.865215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.865390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.866347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:17.866504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.868007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:17.887268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.891135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 996/1968] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:17.897661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5912b-26b2-4b9b-be07-574addd1afaf None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.903086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.904685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.904685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.906345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.907081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.909111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.011122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 973/1969] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:17 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:18.011637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.028536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485cbe-4872-466c-b1d1-113fd672d41d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.102168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.102821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.103107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.103636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.104025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.106012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.216505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 997/1970] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:18 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:18.220941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.232104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d39a-a2d9-45d4-b63b-0f1641680f4f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.234618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:18.238771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.239470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.239754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.240058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.240679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.242259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.252923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 974/1971] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:18.257567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.269571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7ea8-1834-493b-9af5-c280df76d462 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.275263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.276098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.276591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.277020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.278011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.279767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b037d-175f-4678-be86-b2a668546a0a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.292985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 998/1972] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:18.298755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.306797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:18.309986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1a4c-3af2-4f1c-8e87-1e15c5a99e41 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.327044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.327773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.329123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.329410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] PATH_INFO: `/v3/projects/d480c86433ed400fabf7b30eebb6d169/users/bbeefc854555412ca111941542da21b4/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.355615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d480c86433ed400fabf7b30eebb6d169, user_id=bbeefc854555412ca111941542da21b4, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.369082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.457768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 975/1973] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:18 2022] PUT /identity/v3/projects/d480c86433ed400fabf7b30eebb6d169/users/bbeefc854555412ca111941542da21b4/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:18.459509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.459929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.460311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.480585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:18.481895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.543766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 999/1974] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:18.554573 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.556496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.629245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d375-12d9-43a6-b59d-0e02868528ed admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.634039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.634548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.634842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.635184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.645710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.647186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f0ec2-1d93-4a4f-938d-6e5dc5b35090 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.657149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 976/1975] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:18.750847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.753580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.774614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5c84-e983-447a-953a-7cff2535c84d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.783734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.784645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.785202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.785352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] PATH_INFO: `/v3/users/cf6c6404c482494288fcc6153d9cf187` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.786854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6c6404c482494288fcc6153d9cf187)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.788849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.999635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6c6404c482494288fcc6153d9cf187'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.017226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6c6404c482494288fcc6153d9cf187'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.017978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6c6404c482494288fcc6153d9cf187'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.019250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6c6404c482494288fcc6153d9cf187'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.114322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6c6404c482494288fcc6153d9cf187'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.130564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1000/1976] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:18 2022] DELETE /identity/v3/users/cf6c6404c482494288fcc6153d9cf187 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:19.135260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.135550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.135823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.160537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:19.162104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.262174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 977/1977] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:19.274748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.277668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.358586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc426-c22e-498d-989e-0434a6c87c1d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.362305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.363503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.363787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.364117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.374046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.375540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.386840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1001/1978] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:19.405710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:19.523425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:19.879906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:20.008146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.010549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.028506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe2d7-fd35-44a4-bee0-3f824f84f930 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.043632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.046702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.048125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.048125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.049104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.049104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] PATH_INFO: `/v3/projects/7f4cd6801df24b8fb79bc3e5fbd12a85` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.051453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4cd6801df24b8fb79bc3e5fbd12a85)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.054878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.062287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c2271-e027-462a-9b2b-a8f874c747eb service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.076635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.076635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.076635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.076635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] PATH_INFO: `/v3/users/d134379f559549ee9d6e79a244113562` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.076993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d134379f559549ee9d6e79a244113562)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.076993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.182475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4cd6801df24b8fb79bc3e5fbd12a85', 'request_id': 'req-dda047ee-7849-46e6-af4d-06c10e70ebcc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.303011 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4cd6801df24b8fb79bc3e5fbd12a85', 'request_id': 'req-dda047ee-7849-46e6-af4d-06c10e70ebcc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.310077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4cd6801df24b8fb79bc3e5fbd12a85', 'request_id': 'req-dda047ee-7849-46e6-af4d-06c10e70ebcc'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.323592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] The token cache is being invalidate because project 7f4cd6801df24b8fb79bc3e5fbd12a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:20.324089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.326685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dda047ee-7849-46e6-af4d-06c10e70ebcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.328180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 978/1979] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:20 2022] DELETE /identity/v3/projects/7f4cd6801df24b8fb79bc3e5fbd12a85 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:20.329636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.329921 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.330191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.364095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] MFA Rules not processed for user `bbeefc854555412ca111941542da21b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:20.365653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.371829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd134379f559549ee9d6e79a244113562'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.386919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd134379f559549ee9d6e79a244113562'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.390089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd134379f559549ee9d6e79a244113562'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.393038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd134379f559549ee9d6e79a244113562'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.449227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 979/1980] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:20.450166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.452092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.481900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd134379f559549ee9d6e79a244113562'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.504723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1002/1981] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:20 2022] DELETE /identity/v3/users/d134379f559549ee9d6e79a244113562 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:20.505873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.509181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.526756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52993ae7-34c6-4e4e-871b-f2f0eb3d0b53 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.571369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a414a-f945-4844-8b20-977ba6f8d6d1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.575223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.575863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.576104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.576430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.586265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.587063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.587419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.587768 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] PATH_INFO: `/v3/users/602f2bd6939d452e8b514d11b1f63c0a` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.589048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602f2bd6939d452e8b514d11b1f63c0a)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.591366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.655242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.656494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05011e-d0ae-4519-80cc-f06352ba2f41 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.665616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1003/1982] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:20.667071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.667354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.667636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.691461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:20.692686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.700481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1004/1983] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:20.711353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.713497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.784226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459eebf9-49af-4e6b-99ea-245ec7400a11 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.788865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.789817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.790332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.790908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.801861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.804845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.811591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:20.821938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1005/1984] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:20.854254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602f2bd6939d452e8b514d11b1f63c0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.855470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602f2bd6939d452e8b514d11b1f63c0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.929208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602f2bd6939d452e8b514d11b1f63c0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.943931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602f2bd6939d452e8b514d11b1f63c0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.950975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602f2bd6939d452e8b514d11b1f63c0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.957903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 980/1985] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:20 2022] DELETE /identity/v3/users/602f2bd6939d452e8b514d11b1f63c0a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:21.220619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:21.332564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.335445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.365236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094506e-36f6-4b7c-a93c-90150fa7eab3 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.451236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.452254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.452659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.453023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] PATH_INFO: `/v3/projects/c91bc3f8879a4373834b377220bfa985` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.454677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91bc3f8879a4373834b377220bfa985)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.457083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.508569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.508569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.523548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb855a2-17d5-4bfb-88b6-601efb431ed7 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.532363 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.533148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.533473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.534840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] PATH_INFO: `/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.536260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b2a9f6fc6a4bb4a68d06da42d18436)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.538717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.600405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91bc3f8879a4373834b377220bfa985', 'request_id': 'req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.694695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91bc3f8879a4373834b377220bfa985', 'request_id': 'req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.701816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91bc3f8879a4373834b377220bfa985', 'request_id': 'req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.714771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b2a9f6fc6a4bb4a68d06da42d18436', 'request_id': 'req-8639d21f-7cb3-44de-b4b9-6fc815f551d9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.715876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] The token cache is being invalidate because project c91bc3f8879a4373834b377220bfa985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:21.716243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.716997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.718608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1006/1986] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:21 2022] DELETE /identity/v3/projects/c91bc3f8879a4373834b377220bfa985 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:21.723647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.725018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.788429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85339b-aef8-42a8-b8e8-aa1cb67379ef admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.816504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b2a9f6fc6a4bb4a68d06da42d18436', 'request_id': 'req-8639d21f-7cb3-44de-b4b9-6fc815f551d9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.823562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b2a9f6fc6a4bb4a68d06da42d18436', 'request_id': 'req-8639d21f-7cb3-44de-b4b9-6fc815f551d9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.834634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] The token cache is being invalidate because project e5b2a9f6fc6a4bb4a68d06da42d18436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:21.835051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.835814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8639d21f-7cb3-44de-b4b9-6fc815f551d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.837293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 981/1987] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:21 2022] DELETE /identity/v3/projects/e5b2a9f6fc6a4bb4a68d06da42d18436 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:21.842084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc565-8ed4-4395-afb7-ff90b05a91c2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.842384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc565-8ed4-4395-afb7-ff90b05a91c2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.842586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc565-8ed4-4395-afb7-ff90b05a91c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.849274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.849942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.850224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.850599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] PATH_INFO: `/v3/users/562669426830436d951f514c74ec4663` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.851828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562669426830436d951f514c74ec4663)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.853748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.862783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6dbdc565-8ed4-4395-afb7-ff90b05a91c2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:21.864047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6dbdc565-8ed4-4395-afb7-ff90b05a91c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.872355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 982/1988] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:21.881837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.882120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.882393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.901492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:21.902709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.910403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 983/1989] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:21.914676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.923753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c4e3-2bc4-4d44-9c12-21d55cc79cd5 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.928895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.929493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.930018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.930018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.934220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:21.934220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.934220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.945381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 984/1990] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:21.949959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.959984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff690-9092-4aaf-82f8-026a6535f89e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.965115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.965703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.965988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.966262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.966926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.968873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.034358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562669426830436d951f514c74ec4663'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.046520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562669426830436d951f514c74ec4663'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.047417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562669426830436d951f514c74ec4663'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.048122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562669426830436d951f514c74ec4663'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.052088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 985/1991] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:21 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:22.056072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.057870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.120964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3c7d-460c-4fbd-a8dd-818f9228a317 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.125565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.126173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.126478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.126763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.127401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.129383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.129952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562669426830436d951f514c74ec4663'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.143290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1007/1992] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:21 2022] DELETE /identity/v3/users/562669426830436d951f514c74ec4663 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:22.267892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 986/1993] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:22.275574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.337287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa98b-6439-4607-8848-1cb6150183a2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.342002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.342652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.342932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.343206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.343863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.345491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.356784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1008/1994] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:22.361330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.373049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a3b7-3a9d-417c-8d88-a0b41352a403 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.379560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.380232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.380516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.380789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.382049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.384001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f138b52-f2d0-4105-9e0b-f941ed5bedb3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.400684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 987/1995] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:22.405625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.421804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3191e-250a-4844-bcf0-fa0767225881 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.429371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.430317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.430864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.431440 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] PATH_INFO: `/v3/projects/fe07521b105b48abb0680dce1d979338/users/a2b4cf8433c648ddb0d776ea19d9a648/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.465564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe07521b105b48abb0680dce1d979338, user_id=a2b4cf8433c648ddb0d776ea19d9a648, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.474704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc571420-1a26-4350-a7b0-ad6ebeffe1d3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.502354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:22.529888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.530187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.530559 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.533180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1009/1996] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:22 2022] PUT /identity/v3/projects/fe07521b105b48abb0680dce1d979338/users/a2b4cf8433c648ddb0d776ea19d9a648/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:22.536621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:22.556757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.557300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.559473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] MFA Rules not processed for user `bbeefc854555412ca111941542da21b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:22.559776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.560721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.594908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] MFA Rules not processed for user `a2b4cf8433c648ddb0d776ea19d9a648`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:22.595848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.641628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 988/1997] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:22.679548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1010/1998] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:22.690813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.698184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.700303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.776853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2661c-1de5-4d54-bd56-3bbacf3338b7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.782119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.782787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.783141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.783485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.784262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.786340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.839716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38d17-2dfc-4750-ba03-347c1e1c4231 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.846851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.847654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.848046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.848447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] PATH_INFO: `/v3/projects/d320700f142f485b8f0629250b330f8f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.849762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d320700f142f485b8f0629250b330f8f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.851932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.904083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 989/1999] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/projects => generated 393 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:22.908515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.943535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:22.995322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5486ed-6c9f-49b5-90f5-3cc73b221be9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.003639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd320700f142f485b8f0629250b330f8f', 'request_id': 'req-3c4700df-af2a-491e-81cb-6e067a35681f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.093942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.094195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd320700f142f485b8f0629250b330f8f', 'request_id': 'req-3c4700df-af2a-491e-81cb-6e067a35681f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.094812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.095200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.096098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.097294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.100982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.106594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd320700f142f485b8f0629250b330f8f', 'request_id': 'req-3c4700df-af2a-491e-81cb-6e067a35681f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.114355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] The token cache is being invalidate because project d320700f142f485b8f0629250b330f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:23.114691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.115380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3c4700df-af2a-491e-81cb-6e067a35681f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.117059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1011/2000] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:22 2022] DELETE /identity/v3/projects/d320700f142f485b8f0629250b330f8f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:23.124006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852b-966f-45c3-91db-c13bcb0b791c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.124260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852b-966f-45c3-91db-c13bcb0b791c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.124535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852b-966f-45c3-91db-c13bcb0b791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.146464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ff50852b-966f-45c3-91db-c13bcb0b791c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:23.147673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ff50852b-966f-45c3-91db-c13bcb0b791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.157679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1012/2001] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:23.166089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.166376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.166685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.177210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 990/2002] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/users => generated 303 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:23.183571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.185338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.197036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:23.198279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.205556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2cf1e-ddd6-4e56-a56c-d09bb3791385 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.211715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1013/2003] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:23.212934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.223163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.223791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.224097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.224326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.224644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3bcf-ff93-4461-a36b-b46437252ae9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.224987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.226672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.231246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.232001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.232418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.233146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.235480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:23.235905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.240441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.264342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 991/2004] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:23.265628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.282133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1014/2005] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:23.282269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3e305-09cc-46d3-8330-00006a5a8c13 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.285962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.288452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.289076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.289360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.289632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] PATH_INFO: `/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f/users/b07975d9d961469cadfe0f66420bdcab/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.297142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81062ef-ef8f-4137-a524-6cf7ae00b75f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.311339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.312877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.313290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.313668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.314472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.325762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.331298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5f3ce6c47540ba98af037d2a5a9e7f, user_id=b07975d9d961469cadfe0f66420bdcab, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.334414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.334721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:23.509427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 992/2006] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:23 2022] PUT /identity/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f/users/b07975d9d961469cadfe0f66420bdcab/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:23.511892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.515036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1015/2007] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:23 2022] POST /identity/v3/projects => generated 361 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:23.516472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.519345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.594012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae13f-28f0-4d6c-b2dc-cafaa114585c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.621904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dd0b8-f748-4ad0-9476-4e8c0139d3be admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.628413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.629021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.629308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.629585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.630364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.632050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.653341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1016/2008] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:23.654574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.667873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592577d-9db0-4098-85a4-4288a309dd63 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.676978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.677153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.677442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.679724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.679724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.681063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.696801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.697566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.698178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.698557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.701726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.798198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1017/2009] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:23 2022] POST /identity/v3/users => generated 281 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:23.799418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.813606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.813606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.814682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129d6d-7e24-489d-b54b-bbf7d37bd6b1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.821207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 993/2010] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:23.822135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.823567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.830005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.833071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7f1f-5d58-4eec-8943-9477fdac21ee service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.836143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.836143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] PATH_INFO: `/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f/users/b07975d9d961469cadfe0f66420bdcab/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.838083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5f3ce6c47540ba98af037d2a5a9e7f, user_id=b07975d9d961469cadfe0f66420bdcab, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.839789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.840566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.840984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.841262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.841908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.842033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb855-9132-409e-b71f-5622833efdc4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.843524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.865337 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 994/2011] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:23.869276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.870071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1018/2012] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:23 2022] PUT /identity/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f/users/b07975d9d961469cadfe0f66420bdcab/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:23.881517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4d37-e9f3-4cf9-a88d-ea8d1b695598 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.882828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.883112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.883681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.934658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] MFA Rules not processed for user `b07975d9d961469cadfe0f66420bdcab`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:23.937814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.974252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:23.976366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.978082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.978082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.978082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.978738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.980477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.995413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 995/2013] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:23.996800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:24.008766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81108d58-e929-4cd7-b0d6-85fc12affdb8 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.015797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.016245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.016705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.019817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] PATH_INFO: `/v3/projects/95ba01e21b4d4a67a433ff31003e095c/users/a9517ca712af485faa902d02c6f1f8d5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.021524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1019/2014] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:24.033169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:24.035382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:24.039847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ba01e21b4d4a67a433ff31003e095c, user_id=a9517ca712af485faa902d02c6f1f8d5, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.043033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7be3f2-9c85-42f3-8577-84aaffac7d29 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:24.056424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:24.121633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 996/2015] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:23 2022] PUT /identity/v3/projects/95ba01e21b4d4a67a433ff31003e095c/users/a9517ca712af485faa902d02c6f1f8d5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:24.134492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.134823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.135237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.141124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c363fde-8186-4498-8baf-f314a2448712 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.178773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] MFA Rules not processed for user `a9517ca712af485faa902d02c6f1f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:24.181328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:24.240466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.241343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.241843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.242381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.319310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 997/2016] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:24.351158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.352698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:24.363358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1020/2017] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:24.420563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:24.427929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240dda0-b2fa-44d4-aa6c-96f037e11306 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.431777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.432393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.432677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.432949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.434727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:24.514032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.515644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:24.527215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 998/2018] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:24.801365 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:24.810480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73565dee-2f1b-4e30-be04-6335246eaf43 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.817975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.823343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.823343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.823343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.828997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.830799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f300d-9fbe-4e72-b7df-f6fd422d5b28 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:24.840776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1021/2019] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:24.858434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:24.964636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f61f-c4e1-48fb-abcc-cc22c91947de service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.970081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.970791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.971129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.972368 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] PATH_INFO: `/v3/users/a9517ca712af485faa902d02c6f1f8d5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.973572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9517ca712af485faa902d02c6f1f8d5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.979056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:25.168222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9517ca712af485faa902d02c6f1f8d5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.168967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9517ca712af485faa902d02c6f1f8d5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.300215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9517ca712af485faa902d02c6f1f8d5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.346920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9517ca712af485faa902d02c6f1f8d5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.355555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9517ca712af485faa902d02c6f1f8d5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.363097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 999/2020] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:24 2022] DELETE /identity/v3/users/a9517ca712af485faa902d02c6f1f8d5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:25.368988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.371002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.371384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.382367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:25.402597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:25.403888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.453012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:25.477010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1022/2021] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:25.488168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:25.489772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.573177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d648-5098-464a-8f6c-dfd6f4e8f852 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:25.590376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:25.590376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.590780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.591186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.603725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:25.607879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940827-4e08-43c9-8bb9-275bd2bba960 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:25.621057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1000/2022] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:26.189496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.191722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.204226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e243a-1560-4984-9ca6-a9682b19053a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.210314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.210777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.211068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.211351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] PATH_INFO: `/v3/projects/95ba01e21b4d4a67a433ff31003e095c` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.212501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ba01e21b4d4a67a433ff31003e095c)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.214841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.325613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ba01e21b4d4a67a433ff31003e095c', 'request_id': 'req-3ad78092-90ae-4358-afe8-e12a66ae10ab'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:26.398559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ba01e21b4d4a67a433ff31003e095c', 'request_id': 'req-3ad78092-90ae-4358-afe8-e12a66ae10ab'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:26.411156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ba01e21b4d4a67a433ff31003e095c', 'request_id': 'req-3ad78092-90ae-4358-afe8-e12a66ae10ab'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:26.423406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] The token cache is being invalidate because project 95ba01e21b4d4a67a433ff31003e095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:26.423702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:26.424889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3ad78092-90ae-4358-afe8-e12a66ae10ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:26.427815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1023/2023] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:26 2022] DELETE /identity/v3/projects/95ba01e21b4d4a67a433ff31003e095c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:26.434723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.435575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.435871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.460758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:26.465719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.543101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1001/2024] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:26.548863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.549986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.550357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.574148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:26.575778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.586395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1024/2025] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:26.590298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.602390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184214d-89e1-4aa7-aaa9-3a7972531bd6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.608170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.609117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.609693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.610220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.611326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:26.612627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.614653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.630994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1002/2026] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:26.635294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.647522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301713d-bc64-441e-9d14-657dd88a8f1d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.653466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.654266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.654743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.655178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.657425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.657751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.789851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1025/2027] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:26.794362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.805714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55edb57-ecce-4232-8870-d47eca77d33f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.889325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.889895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.890369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.890688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.891396 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.893730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.051354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1003/2028] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:27.053204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.066230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2db8b-14a5-4f54-9546-f158ce02eed9 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.076046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.076046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.076046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.076046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.076348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.077091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.091871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1026/2029] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:27.095096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.106554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59f59-79f0-402a-8176-11477ef07e7d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.111863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.112593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.112943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.113289 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.114023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.115994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d94e7-d3d2-49a6-a8de-ff0f1228f142 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.128224 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1004/2030] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:27.132479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.142346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee4f4-8ca7-4a0f-8832-bfb41bd6b2e3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.148302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.149061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.149406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.149747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] PATH_INFO: `/v3/projects/9704ba91d75d485c9b3dc324cbc6987a/users/8bff69fc3f2141a7a8bb6b8fdd66415f/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.167598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9704ba91d75d485c9b3dc324cbc6987a, user_id=8bff69fc3f2141a7a8bb6b8fdd66415f, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.171228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990b5b6-d4e1-42dd-8723-d305b2ec7989 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.247152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b31-050f-4126-a004-bf7c581e9423 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.247461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b31-050f-4126-a004-bf7c581e9423 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.247737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97b31-050f-4126-a004-bf7c581e9423 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.249067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1005/2031] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:57:27.282427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1027/2032] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:27 2022] PUT /identity/v3/projects/9704ba91d75d485c9b3dc324cbc6987a/users/8bff69fc3f2141a7a8bb6b8fdd66415f/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:27.292693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.292979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.293249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.297289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.297575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.297827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.315531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.316784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.327228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] MFA Rules not processed for user `8bff69fc3f2141a7a8bb6b8fdd66415f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.328418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.406367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1006/2033] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.412636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.414265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.420303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1028/2034] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.421346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.423207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.439784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6e896-f3a7-464c-862b-2c6d68a3aa2c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.446266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.446999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.447289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.447568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.457329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.459177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.471834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1029/2035] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:27.473076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.474861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.498395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b5e40-9b0a-4a46-8186-998197b10c8d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.504062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.504702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.504974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.505443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] PATH_INFO: `/v3/users/d648eccdff80444f884c1fe56c8abe76` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.506639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d648eccdff80444f884c1fe56c8abe76)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.509752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.530136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:27.547261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223e160-8480-4246-8851-ffd68cdbbced service placement] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.555733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.556284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.557093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.557584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.561296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:27.570160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.571641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.582681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1030/2036] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:27.787127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd648eccdff80444f884c1fe56c8abe76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.787783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd648eccdff80444f884c1fe56c8abe76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.859926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd648eccdff80444f884c1fe56c8abe76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.875632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd648eccdff80444f884c1fe56c8abe76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.884057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5572024e-2ef3-4706-a7bd-1082775f2df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd648eccdff80444f884c1fe56c8abe76'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.890545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1007/2037] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:27 2022] DELETE /identity/v3/users/d648eccdff80444f884c1fe56c8abe76 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:28.207332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.218436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a7059-00f8-4f86-83ed-83d776784004 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.305957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.306799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.307237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.307616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] PATH_INFO: `/v3/projects/99a854f82f424133b14e38d30e99594e` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.308873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a854f82f424133b14e38d30e99594e)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.311796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.448158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a854f82f424133b14e38d30e99594e', 'request_id': 'req-b14a69c9-6c05-4b55-8610-c657de228a8b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.556338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a854f82f424133b14e38d30e99594e', 'request_id': 'req-b14a69c9-6c05-4b55-8610-c657de228a8b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.559722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a854f82f424133b14e38d30e99594e', 'request_id': 'req-b14a69c9-6c05-4b55-8610-c657de228a8b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.571664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] The token cache is being invalidate because project 99a854f82f424133b14e38d30e99594e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:28.572108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.573378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-b14a69c9-6c05-4b55-8610-c657de228a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.579605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1031/2038] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:28 2022] DELETE /identity/v3/projects/99a854f82f424133b14e38d30e99594e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:28.580412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.580871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.581006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.600789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:28.602058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.666058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1008/2039] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:28.674727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.675385 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.675844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.698257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:28.699746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.708261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1032/2040] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:28.712904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.723981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34f77-8106-491d-9e95-17f815ed94e8 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.728933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.730602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.730602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.730602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.731033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:28.731344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.732940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.746366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1009/2041] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:28.750822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.760814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec7fa-592c-496f-8449-5f9127ffe75f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.765680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.766293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.766612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.766880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.767523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.769621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.864397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1033/2042] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:28.868721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.879278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125747ea-9186-4f1a-b204-89b41b36b2fa admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.939119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.939852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.940082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.940354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.941013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.942999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.036481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1010/2043] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:29.040391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.052124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e30d3-ff92-48a0-ac61-a693f8123837 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.057017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.057624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.057903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.058178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.058926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.060538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.072782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1034/2044] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:29.076024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.086917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef76d-2252-4801-b7f4-afa6e40974b3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.091781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.092502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.092960 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.093365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.094109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.096562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67e82-3ba2-4d8f-b212-90ec5ae8443c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.112159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1011/2045] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:29.113831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.125297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c136e-04a1-471e-8fbb-5a3b9e96139e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.131762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.132545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.133296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.133522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] PATH_INFO: `/v3/projects/3f81e65b01fc4f508ff1843688f63020/users/c8072b6bbaad4d4780ecf3ca96d098f5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.156585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f81e65b01fc4f508ff1843688f63020, user_id=c8072b6bbaad4d4780ecf3ca96d098f5, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.160269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.262957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1035/2046] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:29 2022] PUT /identity/v3/projects/3f81e65b01fc4f508ff1843688f63020/users/c8072b6bbaad4d4780ecf3ca96d098f5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:29.268965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.269511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.270259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.296614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.298378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.369638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1012/2047] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.380922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.382706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.459021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394efc6-0d7c-4ed7-b84f-364b6d4b3754 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.467130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.467705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.468040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.468484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.483790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.485415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7265ac-0bc6-47e2-985d-149d16904d83 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.497972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1036/2048] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:30.029204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.031571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.044175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844105e-ba35-4fda-bc35-e2d3257a9add None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.049072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.049701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.049982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.050257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] PATH_INFO: `/v3/users/a2b4cf8433c648ddb0d776ea19d9a648` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.051434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b4cf8433c648ddb0d776ea19d9a648)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.053388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.257675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:30.278409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b4cf8433c648ddb0d776ea19d9a648'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:30.279200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b4cf8433c648ddb0d776ea19d9a648'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:30.341361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:30.365115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b4cf8433c648ddb0d776ea19d9a648'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:30.381751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b4cf8433c648ddb0d776ea19d9a648'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:30.389037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b4cf8433c648ddb0d776ea19d9a648'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:30.396715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1013/2049] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:30 2022] DELETE /identity/v3/users/a2b4cf8433c648ddb0d776ea19d9a648 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:30.401473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.401997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.402228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.423496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:30.425534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.526554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1037/2050] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:30.536718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.538700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.602919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0ab65-edd4-450b-8b10-fa05615f36a5 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.606599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.607216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.607499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.607778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.616755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.618186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.628401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1014/2051] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:30.849004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.850565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.864340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c9c7-b4e1-46b5-98de-745cf4fbc568 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.869957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.870986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.871363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.871697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] PATH_INFO: `/v3/users/8bff69fc3f2141a7a8bb6b8fdd66415f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.873207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bff69fc3f2141a7a8bb6b8fdd66415f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.875296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:31.127028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bff69fc3f2141a7a8bb6b8fdd66415f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.141012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bff69fc3f2141a7a8bb6b8fdd66415f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.147109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bff69fc3f2141a7a8bb6b8fdd66415f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.148367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bff69fc3f2141a7a8bb6b8fdd66415f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.199554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:31.201542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.215952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c746-dc24-41a8-8c25-0b53712043f2 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:31.221210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7b09c612-16d9-43f8-836d-4e8b89e83c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bff69fc3f2141a7a8bb6b8fdd66415f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.221829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:31.222609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.222990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.223333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] PATH_INFO: `/v3/projects/fe07521b105b48abb0680dce1d979338` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.224666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe07521b105b48abb0680dce1d979338)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:31.230715 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:31.238127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1038/2052] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:30 2022] DELETE /identity/v3/users/8bff69fc3f2141a7a8bb6b8fdd66415f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:31.243134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.243668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.244857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.271715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:31.273088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.360961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1039/2053] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:31.372674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:31.375901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.389436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe07521b105b48abb0680dce1d979338', 'request_id': 'req-715d4efc-84be-4e51-a616-0dd2122f6f0d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.477476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acc8b-b2da-4edf-8ba7-bb8eab5ffd44 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:31.506694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe07521b105b48abb0680dce1d979338', 'request_id': 'req-715d4efc-84be-4e51-a616-0dd2122f6f0d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.514063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe07521b105b48abb0680dce1d979338', 'request_id': 'req-715d4efc-84be-4e51-a616-0dd2122f6f0d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.554434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] The token cache is being invalidate because project fe07521b105b48abb0680dce1d979338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:31.554769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.568102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.569688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:31.573832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.573832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.573832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.574084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1015/2054] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:31 2022] DELETE /identity/v3/projects/fe07521b105b48abb0680dce1d979338 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:31.578099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:31.580566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.583744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.690372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d4efc-84be-4e51-a616-0dd2122f6f0d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:31.697447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:31.698599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.699159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.699820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] PATH_INFO: `/v3/users/b07975d9d961469cadfe0f66420bdcab` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.701848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07975d9d961469cadfe0f66420bdcab)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:31.704504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:31.747613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:31.749165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:31.763162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1040/2055] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:31.956007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07975d9d961469cadfe0f66420bdcab'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.957712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07975d9d961469cadfe0f66420bdcab'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.041947 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07975d9d961469cadfe0f66420bdcab'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.059160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07975d9d961469cadfe0f66420bdcab'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.069353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07975d9d961469cadfe0f66420bdcab'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.082432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1016/2056] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:31 2022] DELETE /identity/v3/users/b07975d9d961469cadfe0f66420bdcab => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:32.497269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:32.498820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.511687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71e0c-823f-437a-869f-aca5c69369a6 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:32.579914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:32.607963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:32.608832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.609324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.610150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] PATH_INFO: `/v3/projects/9704ba91d75d485c9b3dc324cbc6987a` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.614683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9704ba91d75d485c9b3dc324cbc6987a)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:32.618316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:32.652161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:32.835375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:32.836985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.866608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f107ac-a655-448c-9686-95f0e2c549d6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:32.876022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9704ba91d75d485c9b3dc324cbc6987a', 'request_id': 'req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.952029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:32.952690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.952978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.953257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] PATH_INFO: `/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.955629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5f3ce6c47540ba98af037d2a5a9e7f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:32.957659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:32.971551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9704ba91d75d485c9b3dc324cbc6987a', 'request_id': 'req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.982219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9704ba91d75d485c9b3dc324cbc6987a', 'request_id': 'req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.004401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] The token cache is being invalidate because project 9704ba91d75d485c9b3dc324cbc6987a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:33.005192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.005795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf2611e-c5b8-4dc3-88a2-be0d933f34e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.007408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1041/2057] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:32 2022] DELETE /identity/v3/projects/9704ba91d75d485c9b3dc324cbc6987a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:33.013053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a87e-80fc-49f6-b304-bbe00911f988 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.013344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a87e-80fc-49f6-b304-bbe00911f988 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.013624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a87e-80fc-49f6-b304-bbe00911f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.038947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1a66a87e-80fc-49f6-b304-bbe00911f988 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:33.040360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1a66a87e-80fc-49f6-b304-bbe00911f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.054619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1042/2058] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:33.057944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.058569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.059183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.090079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:33.091115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.108463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1043/2059] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:33.117541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.123161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5f3ce6c47540ba98af037d2a5a9e7f', 'request_id': 'req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.136896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5a542-4129-4c5a-ad89-236a6f0e1578 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.180664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5f3ce6c47540ba98af037d2a5a9e7f', 'request_id': 'req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.188891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5f3ce6c47540ba98af037d2a5a9e7f', 'request_id': 'req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.201608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] The token cache is being invalidate because project cf5f3ce6c47540ba98af037d2a5a9e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:33.202135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.202891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-cff3ee2c-6b3c-4b0b-b41c-de859a57b9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.204727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1017/2060] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:32 2022] DELETE /identity/v3/projects/cf5f3ce6c47540ba98af037d2a5a9e7f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:33.209834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a29246-d30c-4535-9c76-2906925272ca None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.210127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a29246-d30c-4535-9c76-2906925272ca None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.212009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a29246-d30c-4535-9c76-2906925272ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.231529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.232524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.233238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.233512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.234187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:33.234550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.236932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.242338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-32a29246-d30c-4535-9c76-2906925272ca None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:33.243928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-32a29246-d30c-4535-9c76-2906925272ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.254498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1044/2061] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:33.258146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.259941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.263437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1018/2062] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:33.272283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.272750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.272874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.283834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df770-6e3f-4ca0-b97a-046c27602faa admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.290225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.290955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.291403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.291686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.292357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.294325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.308350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:33.309843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.320032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1019/2063] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:33.324786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.339097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facd62a-a0c2-481c-9d79-8bfa6c011237 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.345015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.346422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.346735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.347028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.347659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:33.347961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.349572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.369423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1020/2064] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:33.376286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.390092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe472-2c5d-4a39-bbf6-7ae2f103affe admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.395720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.396605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.396957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.397585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.398032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.400127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.419944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1045/2065] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:33.421453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.505565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1021/2066] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:33.509722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.533932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293cc4-bcb5-44ca-90f4-25ea09df806f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.615664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f6da-54de-4d1c-b2fe-f0eb2795e0a1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.623878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.625511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.630608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.630608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.630608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.630608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.631241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.632075 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.632551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.633029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.634009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.636671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.743089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1022/2067] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:33.748350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.759303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1046/2068] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:33 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:33.763799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.765350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f13d-d2a3-4b30-8f4a-96aceb409a24 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.776460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251104a-d37a-4799-809c-13cef1cafed4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.782418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.782706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.782980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.784196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.784309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.784510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.784609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.784843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.785267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.785509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.787180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.787821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.798583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1023/2069] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:33.800205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1047/2070] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:33.802351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.808441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.814522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f691-4b31-4219-bef2-a4c3b4b34bd9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.828984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b7a9-d7db-4e24-bde3-713858d6858e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.838486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.838486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.838486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.838486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.838885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.838958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.839448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.839985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.840336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.840962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.841527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.843371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.856894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1024/2071] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:33.864146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1048/2072] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:33.868494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.873237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.879854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59305-6583-4b32-aa1b-59fe17a50b72 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.887280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.887969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.890752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.893546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] PATH_INFO: `/v3/projects/d31edbdd61b743208104cb7b70cab3fd/users/03a032244ff043698d887787c0db4f02/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.902641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156988-b003-46d9-8510-40e0d370509a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.918155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.918955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.919244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.919522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] PATH_INFO: `/v3/projects/9e901d0f47a946ba8e035235e8ab4715/users/e96aad9e6a06452794b8e331244d8a32/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.927992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31edbdd61b743208104cb7b70cab3fd, user_id=03a032244ff043698d887787c0db4f02, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.931755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef979f-a159-4e9f-875c-fa6631044db7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.938142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e901d0f47a946ba8e035235e8ab4715, user_id=e96aad9e6a06452794b8e331244d8a32, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.941236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a665d-e438-4a74-a0fa-938a2c714237 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.101449 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1025/2073] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:33 2022] PUT /identity/v3/projects/d31edbdd61b743208104cb7b70cab3fd/users/03a032244ff043698d887787c0db4f02/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:34.101680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1049/2074] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:33 2022] PUT /identity/v3/projects/9e901d0f47a946ba8e035235e8ab4715/users/e96aad9e6a06452794b8e331244d8a32/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:34.103902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.104190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.104488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.109791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.115641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.115641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.145684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] MFA Rules not processed for user `03a032244ff043698d887787c0db4f02`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:34.146806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.154602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] MFA Rules not processed for user `e96aad9e6a06452794b8e331244d8a32`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:34.155727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.239013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:34.262210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1050/2075] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:34.266059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1026/2076] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:34.266803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.278394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.280038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.385192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b88e-22b2-4783-b357-c25cdbf2e723 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.397572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.402753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.402753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.402753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.402753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.404531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.411128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758eb44-5ff3-482e-b3a1-06667186347d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.417115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.417816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.418183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.418497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.437013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.443624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.456518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1027/2077] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:34.544313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1051/2078] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:34.548255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.576323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9890e86-6428-49a0-857b-d252e94a4729 service glance] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.687763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.688606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.688901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.689907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.690805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.693869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.806691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1028/2079] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:34.808872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.843249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137cce9-7ca3-446f-9deb-67b0668d2622 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.852208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.856997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.856997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.856997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.856997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.857840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.872917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1052/2080] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:34.877758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.890577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67d87-0173-4f05-85e4-83c4382e580b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.899160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.899808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.900209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.900666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.901444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.903252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bfd2a-7a41-4402-9361-2593cd8e8953 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.917890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1029/2081] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:34.921766 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.934231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803b736-2a89-4df2-b424-2ec7100680bf admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.942222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.943058 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.943318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.943665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] PATH_INFO: `/v3/projects/0c46c54d65e14f229998e5457ff452d6/users/32d4d7a3dfff435691b39025aa9bc8b2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.996126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:34.996126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c46c54d65e14f229998e5457ff452d6, user_id=32d4d7a3dfff435691b39025aa9bc8b2, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.001338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.111156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1053/2082] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:34 2022] PUT /identity/v3/projects/0c46c54d65e14f229998e5457ff452d6/users/32d4d7a3dfff435691b39025aa9bc8b2/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:35.121952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.122234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.122554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.156106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] MFA Rules not processed for user `32d4d7a3dfff435691b39025aa9bc8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:35.158302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:35.247563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1030/2083] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:35.252409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.341318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11ff4-85e0-4018-9dbf-49222fcfd37e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.347292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.347994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.348283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.348563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.349281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.351231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.490975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1054/2084] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:35.491788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.505621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e076-d58e-44a9-bf8e-65aa75064d61 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.574268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.574911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.575193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.575466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.576103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.578109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.696821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1031/2085] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:35.698488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.717539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a8f9-899b-4869-8283-c75575bbb52b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.728277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.729189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.729189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.729483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.730128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.732735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.754956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1055/2086] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:35.759876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.771287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bd50-b233-4d7a-bc9e-99f695c47ad2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.779126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.779949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.780331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.780726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] PATH_INFO: `/v3/projects/de972f1ca486486fa3a3fbc920428a16/users/6476ede6c9f64ec38f526a93d3e94196/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.804041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de972f1ca486486fa3a3fbc920428a16, user_id=6476ede6c9f64ec38f526a93d3e94196, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.806978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.915299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1032/2087] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:35 2022] PUT /identity/v3/projects/de972f1ca486486fa3a3fbc920428a16/users/6476ede6c9f64ec38f526a93d3e94196/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:35.920889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.932922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abb22-aad6-491d-84ba-49aee93d0f75 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:36.005220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:36.009113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:36.009783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.010196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.010675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.011871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:36.013669 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e436304-e84c-4311-8b02-255c91a29866 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:36.034375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1056/2088] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:36.035876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:36.051120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9496228-3cd1-4a41-893f-60d55fd22409 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:36.060189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:36.061764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.062255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.062725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] PATH_INFO: `/v3/projects/de972f1ca486486fa3a3fbc920428a16/users/6476ede6c9f64ec38f526a93d3e94196/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.066686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=de972f1ca486486fa3a3fbc920428a16, user_id=6476ede6c9f64ec38f526a93d3e94196, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:36.070128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:36.095837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1033/2089] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:36 2022] PUT /identity/v3/projects/de972f1ca486486fa3a3fbc920428a16/users/6476ede6c9f64ec38f526a93d3e94196/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:36.102565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.102858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.103137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.206696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] MFA Rules not processed for user `6476ede6c9f64ec38f526a93d3e94196`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:36.206696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:36.302492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1057/2090] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:36.323673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:36.327843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:36.418969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff11dec-5c69-4322-bb58-3a2b6801f8bf admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:36.428079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:36.428818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.430408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.430408 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.442676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:36.444779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be19ea-bc11-4eca-a841-2e71364a1930 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:36.458139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1034/2091] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:36.596809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:36.623452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0b1cf-0543-47ee-b229-42119f358364 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:36.629015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:36.629664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.630182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.630709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.723070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:36.725242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:36.754072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1058/2092] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:37.005583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde287-5866-4d58-93a3-b92443c02e43 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:37.007213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde287-5866-4d58-93a3-b92443c02e43 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:37.007665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde287-5866-4d58-93a3-b92443c02e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:37.048570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1bbde287-5866-4d58-93a3-b92443c02e43 None None] MFA Rules not processed for user `c8072b6bbaad4d4780ecf3ca96d098f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:37.049659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1bbde287-5866-4d58-93a3-b92443c02e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:37.123934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1035/2093] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:37.139495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:37.141268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:37.243629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b610e7-dce3-4daf-9619-84ce6a2e398c service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:37.250793 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:37.252125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:37.252561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:37.252849 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:37.261936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:37.268117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:37.278645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1059/2094] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:37.404630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:37.519170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:39.335953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:39.421697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:40.062220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2af5-3a14-4547-9553-709ccd61b4aa None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:40.063475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2af5-3a14-4547-9553-709ccd61b4aa None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:40.063922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2af5-3a14-4547-9553-709ccd61b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:40.086770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-96bd2af5-3a14-4547-9553-709ccd61b4aa None None] MFA Rules not processed for user `c8072b6bbaad4d4780ecf3ca96d098f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:40.088364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-96bd2af5-3a14-4547-9553-709ccd61b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:40.103119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1036/2095] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:40.483316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:41.311098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:41.382043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0cac3-2dbd-4b7c-ab7d-0c23fe87ea90 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:41.388288 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:41.388932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:41.389269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:41.389548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] PATH_INFO: `/v3/users/03a032244ff043698d887787c0db4f02` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:41.390708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a032244ff043698d887787c0db4f02)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:41.393858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:41.573818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:41.691185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a032244ff043698d887787c0db4f02'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:41.703643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a032244ff043698d887787c0db4f02'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:41.704817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a032244ff043698d887787c0db4f02'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:41.705414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a032244ff043698d887787c0db4f02'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:41.814665 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a032244ff043698d887787c0db4f02'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:41.835843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1060/2096] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:41 2022] DELETE /identity/v3/users/03a032244ff043698d887787c0db4f02 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:41.840423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:41.841313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:41.841634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:41.869109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:41.870809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:41.947228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1037/2097] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:41.955485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:41.957084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:42.021019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d4a3-52aa-4bb3-a9b2-b07c771dc7d3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:42.025490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:42.026149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:42.026436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:42.026736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:42.039313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:42.042580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:42.051871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1061/2098] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:42.329928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:42.610725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:42.615656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:42.625582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8626e9-e146-4b3d-9af8-042c9d77c058 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:42.635072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:42.636053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:42.636620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:42.637040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] PATH_INFO: `/v3/projects/d31edbdd61b743208104cb7b70cab3fd` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:42.638371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31edbdd61b743208104cb7b70cab3fd)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:42.640966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:42.792153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31edbdd61b743208104cb7b70cab3fd', 'request_id': 'req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:42.905880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31edbdd61b743208104cb7b70cab3fd', 'request_id': 'req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:42.913750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31edbdd61b743208104cb7b70cab3fd', 'request_id': 'req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:42.925392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] The token cache is being invalidate because project d31edbdd61b743208104cb7b70cab3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:42.925688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:42.926345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:42.927853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1038/2099] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:42 2022] DELETE /identity/v3/projects/d31edbdd61b743208104cb7b70cab3fd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:42.932140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:42.943314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491133-27da-4575-a179-8d0a672ce3af service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:43.005485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:43.006214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:43.006538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:43.006816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] PATH_INFO: `/v3/users/32d4d7a3dfff435691b39025aa9bc8b2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:43.007987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d4d7a3dfff435691b39025aa9bc8b2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:43.009928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:43.100728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:43.209226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d4d7a3dfff435691b39025aa9bc8b2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.224328 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d4d7a3dfff435691b39025aa9bc8b2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.225199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d4d7a3dfff435691b39025aa9bc8b2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.226500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d4d7a3dfff435691b39025aa9bc8b2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.304263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d4d7a3dfff435691b39025aa9bc8b2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.318521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1062/2100] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:42 2022] DELETE /identity/v3/users/32d4d7a3dfff435691b39025aa9bc8b2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:43.857028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:43.858600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:43.882576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5c20-8a4c-4655-a1a2-3d4b72674ca2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:43.948360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:43.949191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:43.949484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:43.949767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] PATH_INFO: `/v3/projects/0c46c54d65e14f229998e5457ff452d6` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:43.950946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c46c54d65e14f229998e5457ff452d6)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:43.952907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:44.081830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c46c54d65e14f229998e5457ff452d6', 'request_id': 'req-999f7562-67d9-4985-a15e-9b9481a6b2e4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.178369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c46c54d65e14f229998e5457ff452d6', 'request_id': 'req-999f7562-67d9-4985-a15e-9b9481a6b2e4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.185208 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c46c54d65e14f229998e5457ff452d6', 'request_id': 'req-999f7562-67d9-4985-a15e-9b9481a6b2e4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.195976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] The token cache is being invalidate because project 0c46c54d65e14f229998e5457ff452d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:44.196262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.196901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.198363 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1039/2101] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:43 2022] DELETE /identity/v3/projects/0c46c54d65e14f229998e5457ff452d6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:44.202351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:44.203889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:44.216994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a93a9e-f38b-410f-93f9-695e5b990b30 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:44.279595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:44.280201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:44.280484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:44.280757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] PATH_INFO: `/v3/users/6476ede6c9f64ec38f526a93d3e94196` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:44.282301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6476ede6c9f64ec38f526a93d3e94196)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:44.284620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:44.418507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:44.484211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6476ede6c9f64ec38f526a93d3e94196'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.498683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6476ede6c9f64ec38f526a93d3e94196'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.499550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6476ede6c9f64ec38f526a93d3e94196'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.500438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6476ede6c9f64ec38f526a93d3e94196'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.589775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66f8fbbd-d029-4850-9855-ba6e6a63f1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6476ede6c9f64ec38f526a93d3e94196'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.603559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1063/2102] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:44 2022] DELETE /identity/v3/users/6476ede6c9f64ec38f526a93d3e94196 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:44.728938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:45.124053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.131783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.147380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7562-67d9-4985-a15e-9b9481a6b2e4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.220620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:INSERT=3,keystone:DELETE=4,keystone:SELECT=93 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:45.257881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.258585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.259049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.259334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] PATH_INFO: `/v3/projects/de972f1ca486486fa3a3fbc920428a16` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.260635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=de972f1ca486486fa3a3fbc920428a16)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.262887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.415134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de972f1ca486486fa3a3fbc920428a16', 'request_id': 'req-a6350dd5-798c-4f21-ab82-cdce17c41bbd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:45.477039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de972f1ca486486fa3a3fbc920428a16', 'request_id': 'req-a6350dd5-798c-4f21-ab82-cdce17c41bbd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:45.488307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de972f1ca486486fa3a3fbc920428a16', 'request_id': 'req-a6350dd5-798c-4f21-ab82-cdce17c41bbd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:45.502006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] The token cache is being invalidate because project de972f1ca486486fa3a3fbc920428a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:45.502515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:45.503239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a6350dd5-798c-4f21-ab82-cdce17c41bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:45.509335 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1040/2103] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:45 2022] DELETE /identity/v3/projects/de972f1ca486486fa3a3fbc920428a16 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:45.511659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.512149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.512428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.537616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:45.539874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.642773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1064/2104] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:45.652688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.653037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.658078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.674667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:45.675868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.687376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1041/2105] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:45.692575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.705270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89122b5c-2586-48b8-a93c-2e9d19f79aef None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.710036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.710683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.710965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.711415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.712362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:45.712679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.714286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.733776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1065/2106] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:45.736741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.747739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655429d-dddf-497b-96af-ada1621ebb92 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.754943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.755561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.756911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.756911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.756911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.758803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.878682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:45.889860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1042/2107] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:45.891128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.901372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49690-4a5b-40d1-9f5b-0d1e22cf9b02 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.968522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.970161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.970161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.970416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.971107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.973473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.088861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1066/2108] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:46.091595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:46.110620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb408-a0fe-4e41-9001-239374584142 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:46.135113 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:46.135860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.136245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.136665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.137759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:46.140788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.166723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1043/2109] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:46.168393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:46.186375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094666-6754-47f7-831d-449b9e4b16bf admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:46.211619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:46.212254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.213347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.213635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.216143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:46.218061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccde1d-9ed5-4bdc-978f-7c651bb78162 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.238792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1067/2110] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:46.242909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:46.264508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530972-3a94-45d4-977a-4102fd75094a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:46.271252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:46.271679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.272064 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.272348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] PATH_INFO: `/v3/projects/0fc02aed164646cab75dfec1e96710de/users/6f76f6e1f4754ccd8b0773711cb42952/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.295354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc02aed164646cab75dfec1e96710de, user_id=6f76f6e1f4754ccd8b0773711cb42952, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:46.299041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.415742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1044/2111] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:46 2022] PUT /identity/v3/projects/0fc02aed164646cab75dfec1e96710de/users/6f76f6e1f4754ccd8b0773711cb42952/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:46.428337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd109a4-af07-424f-8378-49c0de91ecc1 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.428618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd109a4-af07-424f-8378-49c0de91ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.428897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd109a4-af07-424f-8378-49c0de91ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.453473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:46.463103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1dd109a4-af07-424f-8378-49c0de91ecc1 None None] MFA Rules not processed for user `6f76f6e1f4754ccd8b0773711cb42952`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:46.464493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1dd109a4-af07-424f-8378-49c0de91ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:46.540106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1068/2112] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:46.551945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:46.553671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:46.632350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f0702-5809-42d5-aa48-960aa8a680a4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:46.638685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:46.639619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.639619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.639925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.653216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:46.654827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.665356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1045/2113] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:48.041123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:48.534708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:48.791538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:49.108266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:49.108690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:49.108970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:49.138308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] MFA Rules not processed for user `bbeefc854555412ca111941542da21b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:49.139552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:49.209187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1069/2114] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:49.602625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:49.659915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.185339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.235781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.636732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.774291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.973917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:51.191567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:51.523650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:52.158257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:52.451071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:52.453222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:52.525503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa5083-593e-41c2-bb22-43d41211fa71 service glance] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:52.530039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:52.530694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:52.530976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:52.531248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] PATH_INFO: `/v3/users/3103154c829740f1812e870b7a28e6f0` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:52.532725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3103154c829740f1812e870b7a28e6f0)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:52.535025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:52.781083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3103154c829740f1812e870b7a28e6f0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:52.781839 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3103154c829740f1812e870b7a28e6f0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:52.870688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3103154c829740f1812e870b7a28e6f0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:52.884591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3103154c829740f1812e870b7a28e6f0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:52.892333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3103154c829740f1812e870b7a28e6f0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:52.898295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1046/2115] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:52 2022] DELETE /identity/v3/users/3103154c829740f1812e870b7a28e6f0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:53.169893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:53.181591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b5f68-5a0e-40c3-a685-26bc7ade05cb None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:53.265810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:53.266494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:53.266790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:53.267039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] PATH_INFO: `/v3/projects/b07b15ebdb38469eb3fada30a99c54fb` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:53.268260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07b15ebdb38469eb3fada30a99c54fb)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:53.270208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:53.409387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07b15ebdb38469eb3fada30a99c54fb', 'request_id': 'req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.521142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07b15ebdb38469eb3fada30a99c54fb', 'request_id': 'req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.532272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07b15ebdb38469eb3fada30a99c54fb', 'request_id': 'req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.545194 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] The token cache is being invalidate because project b07b15ebdb38469eb3fada30a99c54fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:53.547808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.548508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.553990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1070/2116] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:53 2022] DELETE /identity/v3/projects/b07b15ebdb38469eb3fada30a99c54fb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:53.555194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:53.556737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:53.575217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9243e3-4ce4-4e54-9818-0ea5a017ab65 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:53.627114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:53.644894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:53.645546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:53.645830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:53.646107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] PATH_INFO: `/v3/users/70df5f2459ba4de89d3d607de1cdecf4` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:53.647303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] RBAC: Authorizing `identity:delete_user(user_id=70df5f2459ba4de89d3d607de1cdecf4)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:53.649419 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:53.875298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70df5f2459ba4de89d3d607de1cdecf4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.877145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70df5f2459ba4de89d3d607de1cdecf4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.950167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70df5f2459ba4de89d3d607de1cdecf4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.963956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70df5f2459ba4de89d3d607de1cdecf4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.972514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-55090a0c-ae9d-4596-b88e-d822c82744df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70df5f2459ba4de89d3d607de1cdecf4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:53.982572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1047/2117] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:53 2022] DELETE /identity/v3/users/70df5f2459ba4de89d3d607de1cdecf4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:54.244428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.245927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:54.261623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369a9d-8a6a-4bfb-9efa-7c3197cacdaa admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.323095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.323880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.324172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.324451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] PATH_INFO: `/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.325577 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecf51ad2de14dc790a38cb42f9c6919)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.327596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.428672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:54.447166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecf51ad2de14dc790a38cb42f9c6919', 'request_id': 'req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:54.545053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecf51ad2de14dc790a38cb42f9c6919', 'request_id': 'req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:54.552977 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecf51ad2de14dc790a38cb42f9c6919', 'request_id': 'req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:54.565594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] The token cache is being invalidate because project 7ecf51ad2de14dc790a38cb42f9c6919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:54.565894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:54.566626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dbbcb143-43e9-468e-8ce7-3ebdb14d223b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:54.571219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1071/2118] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:54 2022] DELETE /identity/v3/projects/7ecf51ad2de14dc790a38cb42f9c6919 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:54.573597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.574081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.574170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.595251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:54.596555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:54.658344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1048/2119] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:54.665978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.668757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.668757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.686914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:54.688324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:54.696395 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1072/2120] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:54.700998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.711939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f44c4-35d4-4e8e-9228-e79f769acca6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.716555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.720913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.732416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1049/2121] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:54.736842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.746326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4593-3b30-47be-9f12-f425d7eab20e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.751136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.751752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.752157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.752432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.753067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.755054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.858555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1073/2122] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:54.861760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.875763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318ddd-baa9-4407-a184-95a4f54d28f0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.937577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:54.947482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.948103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.948385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.948656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.949314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.951381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.056068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1050/2123] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:55.060249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.071970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6db8-55e9-49dd-adce-5b7bf2f843f3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.077179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.077798 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.078095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.078569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.079241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.080863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.098623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1074/2124] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:55.101361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.112565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f938-6ab2-4f33-9da6-4e09a53bbf56 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.117503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.121698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.121698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.121698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.121698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.121698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0cfe-1f4d-42a7-bbea-8fc58fe620a9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.133484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1051/2125] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:55.137039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.147690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5ecd-0ce5-4629-bb3d-48e2e44e18a5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.157191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.158088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.158376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.158679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] PATH_INFO: `/v3/projects/b9103bcb8377448ab6c29a6e39b54a0d/users/debe7f20059141e192ed4d300e013d77/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.175868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9103bcb8377448ab6c29a6e39b54a0d, user_id=debe7f20059141e192ed4d300e013d77, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.178048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.252460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1075/2126] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:55 2022] PUT /identity/v3/projects/b9103bcb8377448ab6c29a6e39b54a0d/users/debe7f20059141e192ed4d300e013d77/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:55.263441 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.263734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.264010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.293999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] MFA Rules not processed for user `debe7f20059141e192ed4d300e013d77`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:55.295348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:55.364159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1052/2127] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:55.369438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.437188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7af4-b0ba-4039-a48e-e36133b37aac admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.441032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.441663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.441944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.442269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.442904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.444833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.528047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1076/2128] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:55 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:55.534095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.545172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7fa6f-0563-43cb-91f6-78e85a5dffe4 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.607101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.607792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.607986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.608260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.608896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.611221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.723706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1053/2129] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:55 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:55.727598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.738071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16b95-1df0-41e7-94bd-5e2908e6a64d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.742889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.743807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.744090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.744361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.745012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.746890 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.758881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1077/2130] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:55.762844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.778005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179eabc-72a2-422e-b229-64b69b302b84 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.784641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.785244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.785523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.785794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.786463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.788100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf0fbd-81c7-4944-8f6c-681281058b83 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.799057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1054/2131] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:55.803284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.813468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d56b9-7df6-433e-abf8-a0bc7a329bb5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.818082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.818764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.819046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.819322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] PATH_INFO: `/v3/projects/99bad6f8b30c4a4fb8686a6920ccf89c/users/8c95b694636d427bad03dec2b3e2cef3/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.834707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bad6f8b30c4a4fb8686a6920ccf89c, user_id=8c95b694636d427bad03dec2b3e2cef3, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.837346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.911874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1078/2132] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:55 2022] PUT /identity/v3/projects/99bad6f8b30c4a4fb8686a6920ccf89c/users/8c95b694636d427bad03dec2b3e2cef3/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:55.922882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.923728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.923867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.965378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] MFA Rules not processed for user `8c95b694636d427bad03dec2b3e2cef3`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:55.966659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:56.001514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:56.041340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1055/2133] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:56.057869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.062788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:56.120686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d466-a486-468f-915a-a9087434cb26 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.125987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.126629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.126915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.127189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.127831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.129730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.267666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1079/2134] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:56.272020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.293853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa20ae4-eca4-4c07-bdc1-ee5f9d3f9e49 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.402105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.402747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.403031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.403320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.403970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.405895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.516094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.516608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1056/2135] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:56 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:56.527414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d09-b23e-475c-b698-6713bbe4349c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.532486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.533107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.533398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.533675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.534390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.536073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.548072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1080/2136] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:56.552162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.563019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09894acb-92a2-40e8-88f9-026803f640af admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.570341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.571239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.575622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.575622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] PATH_INFO: `/v3/projects/5f35054902e7428a99d2bfb09024b873/users/b0ee1298cdcf4e08b7f124fac683ed07/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.588767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f35054902e7428a99d2bfb09024b873, user_id=b0ee1298cdcf4e08b7f124fac683ed07, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.591478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.686467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1057/2137] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:56 2022] PUT /identity/v3/projects/5f35054902e7428a99d2bfb09024b873/users/b0ee1298cdcf4e08b7f124fac683ed07/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:56.690715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.702157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e942-3c19-4ff7-8062-082f4f5a1be2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.779544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.782048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.782048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.782048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.782048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.783497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499526-914d-4c13-8656-a10430578d8b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.795079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1081/2138] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:56.799895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:56.814551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d71c6-05bf-4f9f-87a8-7f62ef218e73 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:56.824383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:56.828898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.828898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.828898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] PATH_INFO: `/v3/projects/5f35054902e7428a99d2bfb09024b873/users/b0ee1298cdcf4e08b7f124fac683ed07/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.828898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f35054902e7428a99d2bfb09024b873, user_id=b0ee1298cdcf4e08b7f124fac683ed07, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:56.831417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:56.844151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1058/2139] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:56 2022] PUT /identity/v3/projects/5f35054902e7428a99d2bfb09024b873/users/b0ee1298cdcf4e08b7f124fac683ed07/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:56.855763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:56.856462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:56.856938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:56.893653 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] MFA Rules not processed for user `b0ee1298cdcf4e08b7f124fac683ed07`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:56.894952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:56.978596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:56.986504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1082/2140] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:57.027444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:57.029163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:57.093521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730ac9d-b483-47e3-bac0-8bc3bf7ccb56 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:57.098216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:57.098885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:57.099172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:57.099482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:57.159758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:57.182245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:57.182245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:57.195825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1059/2141] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:59.325314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:59.328462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:59.348496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1ec7-0589-4e74-bebb-b4390aa3bce5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:59.352544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:59.353696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:59.354163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:59.354771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:59.435923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:59.442537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f22d2-99f5-4aa0-92a2-ca7fc8d27427 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:59.456668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1083/2142] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:01.064084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:01.072717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acddff2-3cbe-46ff-9ec1-5643270519d6 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:01.076312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:01.076910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:01.077187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:01.077457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:01.086817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:01.088281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:01.099623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1060/2143] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:04.683605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602229e-6ff2-4189-940f-7591c569f0e3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:04.684513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602229e-6ff2-4189-940f-7591c569f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:04.684971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602229e-6ff2-4189-940f-7591c569f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:04.710206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f602229e-6ff2-4189-940f-7591c569f0e3 None None] MFA Rules not processed for user `d04625404c4344bf9d1f11bc14ff69da`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:04.711448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f602229e-6ff2-4189-940f-7591c569f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:04.788384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1084/2144] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:06.076716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:06.165564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb722-ada4-4347-a421-2e6693246a9a service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:06.170382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:06.171633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:06.171911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:06.172263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] PATH_INFO: `/v3/users/debe7f20059141e192ed4d300e013d77` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:06.173639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=debe7f20059141e192ed4d300e013d77)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:06.177188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:06.396382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debe7f20059141e192ed4d300e013d77'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:06.397028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debe7f20059141e192ed4d300e013d77'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:06.492883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debe7f20059141e192ed4d300e013d77'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:06.507648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debe7f20059141e192ed4d300e013d77'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:06.516454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debe7f20059141e192ed4d300e013d77'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:06.524047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1061/2145] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:06 2022] DELETE /identity/v3/users/debe7f20059141e192ed4d300e013d77 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:06.528643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:06.530933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:06.530933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:06.550968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:06.552208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:06.623740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1085/2146] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:06.635672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:06.637103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:06.709174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:06.722948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1f70-e501-4de4-92a7-8c184a96b70b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:06.727030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:06.731832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:06.731832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:06.731832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:06.738702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:06.740407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:06.751923 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1062/2147] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:07.264087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:07.265854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:07.278352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6257e3-09e2-4469-824b-f4397cadac9d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:07.284322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:07.284918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:07.285205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:07.285536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] PATH_INFO: `/v3/projects/b9103bcb8377448ab6c29a6e39b54a0d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:07.286715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9103bcb8377448ab6c29a6e39b54a0d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:07.289989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:07.400488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:07.409984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9103bcb8377448ab6c29a6e39b54a0d', 'request_id': 'req-aae655de-fa12-4054-a349-f575ab94be24'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.469965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9103bcb8377448ab6c29a6e39b54a0d', 'request_id': 'req-aae655de-fa12-4054-a349-f575ab94be24'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.476641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9103bcb8377448ab6c29a6e39b54a0d', 'request_id': 'req-aae655de-fa12-4054-a349-f575ab94be24'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.487273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] The token cache is being invalidate because project b9103bcb8377448ab6c29a6e39b54a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:07.487566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.488219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.489709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1086/2148] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:07 2022] DELETE /identity/v3/projects/b9103bcb8377448ab6c29a6e39b54a0d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:07.493984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:07.504182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a489a-6e0a-47d9-b90f-03f7b9730f9e service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:07.565179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:07.565742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:07.566031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:07.566311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] PATH_INFO: `/v3/users/8c95b694636d427bad03dec2b3e2cef3` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:07.567532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c95b694636d427bad03dec2b3e2cef3)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:07.569551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:07.785688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c95b694636d427bad03dec2b3e2cef3'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.786374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c95b694636d427bad03dec2b3e2cef3'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.857504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c95b694636d427bad03dec2b3e2cef3'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.871480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c95b694636d427bad03dec2b3e2cef3'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.879510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c95b694636d427bad03dec2b3e2cef3'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:07.885876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1063/2149] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:07 2022] DELETE /identity/v3/users/8c95b694636d427bad03dec2b3e2cef3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:08.384673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:08.386168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:08.399069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae655de-fa12-4054-a349-f575ab94be24 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:08.468983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:08.469630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:08.470049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:08.470313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] PATH_INFO: `/v3/projects/99bad6f8b30c4a4fb8686a6920ccf89c` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:08.471913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bad6f8b30c4a4fb8686a6920ccf89c)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:08.473872 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:08.633353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bad6f8b30c4a4fb8686a6920ccf89c', 'request_id': 'req-e4ddf80b-ee19-48ce-acc1-b68a67990442'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:08.755475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bad6f8b30c4a4fb8686a6920ccf89c', 'request_id': 'req-e4ddf80b-ee19-48ce-acc1-b68a67990442'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:08.764634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bad6f8b30c4a4fb8686a6920ccf89c', 'request_id': 'req-e4ddf80b-ee19-48ce-acc1-b68a67990442'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:08.777311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] The token cache is being invalidate because project 99bad6f8b30c4a4fb8686a6920ccf89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:08.777311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:08.777779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:08.779310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1087/2150] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:08 2022] DELETE /identity/v3/projects/99bad6f8b30c4a4fb8686a6920ccf89c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:08.783969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:08.785420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:08.798793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab571-ce8c-407f-ad17-3c22bb9dbda2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:08.855135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:08.855840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:08.856058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:08.856330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] PATH_INFO: `/v3/users/b0ee1298cdcf4e08b7f124fac683ed07` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:08.857457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ee1298cdcf4e08b7f124fac683ed07)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:08.860171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:08.862758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:09.012356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:09.013915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:09.033593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf80b-ee19-48ce-acc1-b68a67990442 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:09.038688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:09.039682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:09.039976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:09.040325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] PATH_INFO: `/v3/users/e96aad9e6a06452794b8e331244d8a32` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:09.041547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96aad9e6a06452794b8e331244d8a32)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:09.043605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:09.078587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ee1298cdcf4e08b7f124fac683ed07'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.079256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ee1298cdcf4e08b7f124fac683ed07'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.143895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ee1298cdcf4e08b7f124fac683ed07'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.157043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ee1298cdcf4e08b7f124fac683ed07'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.164109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bfa74ef2-a9b2-4374-82e1-a40d4bb03ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ee1298cdcf4e08b7f124fac683ed07'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.169968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1064/2151] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:08 2022] DELETE /identity/v3/users/b0ee1298cdcf4e08b7f124fac683ed07 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:09.235414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96aad9e6a06452794b8e331244d8a32'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.239981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:09.254379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96aad9e6a06452794b8e331244d8a32'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.255242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96aad9e6a06452794b8e331244d8a32'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.255909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96aad9e6a06452794b8e331244d8a32'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.378155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96aad9e6a06452794b8e331244d8a32'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:09.391427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1088/2152] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:09 2022] DELETE /identity/v3/users/e96aad9e6a06452794b8e331244d8a32 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:09.395796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:09.396083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:09.396357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:09.430597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:09.431911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:09.518272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1065/2153] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:09.526156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:09.528541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:09.591285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ea66-530e-4684-bdf9-095f803bdc37 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:09.597094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:09.597891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:09.600519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:09.601685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:09.615128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:09.619826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf625a-342d-4752-8a69-6da129901664 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:09.630207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1089/2154] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:09.782551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:09.784452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:09.803282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76805-cd32-42a4-b2e1-19a881f5e1c7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:09.809975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:09.810902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:09.811572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:09.812503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] PATH_INFO: `/v3/projects/5f35054902e7428a99d2bfb09024b873` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:09.814696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f35054902e7428a99d2bfb09024b873)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:09.817693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:09.956309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f35054902e7428a99d2bfb09024b873', 'request_id': 'req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.075212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f35054902e7428a99d2bfb09024b873', 'request_id': 'req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.084920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f35054902e7428a99d2bfb09024b873', 'request_id': 'req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.101770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] The token cache is being invalidate because project 5f35054902e7428a99d2bfb09024b873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:10.102233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.103402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1ab7a7b8-4b24-4787-94fe-edff19f6de9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.104965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1066/2155] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:09 2022] DELETE /identity/v3/projects/5f35054902e7428a99d2bfb09024b873 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:10.110435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.110747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.113845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.154730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:10.156478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.234588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1090/2156] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:10.238405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.239763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.240534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.251677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.263555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:10.265459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.273484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1067/2157] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:10.277901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.288189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfd6bb-a366-41a3-a3d2-4e8c1cd7e912 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.293324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.293956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.294258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.294558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.295213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:10.295693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.297416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.309187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1091/2158] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:10.314265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.318337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.321081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.328089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400df4b-e7af-4916-90a6-7d69217b0641 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.333658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.334302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.334600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.334880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.335846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.336839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672aa4-e33d-49f2-88a6-84f176678d06 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.337684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.341911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.343937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.343937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.343937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] PATH_INFO: `/v3/projects/9e901d0f47a946ba8e035235e8ab4715` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.344971 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e901d0f47a946ba8e035235e8ab4715)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.347011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.414414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1068/2159] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:10.418349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.478945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ed7b-0dea-482e-8dc2-efa219053406 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.487981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e901d0f47a946ba8e035235e8ab4715', 'request_id': 'req-ad4b537f-2aa9-4486-88f3-65807551f808'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.490552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.537114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.537724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.538013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.538340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.538999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.540946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.566701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e901d0f47a946ba8e035235e8ab4715', 'request_id': 'req-ad4b537f-2aa9-4486-88f3-65807551f808'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.573896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e901d0f47a946ba8e035235e8ab4715', 'request_id': 'req-ad4b537f-2aa9-4486-88f3-65807551f808'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.587533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] The token cache is being invalidate because project 9e901d0f47a946ba8e035235e8ab4715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:10.587824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.588496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ad4b537f-2aa9-4486-88f3-65807551f808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:10.600004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1092/2160] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:10 2022] DELETE /identity/v3/projects/9e901d0f47a946ba8e035235e8ab4715 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:10.603709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb983ae-6cfa-40b9-9b08-75c6d730c102 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.603997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb983ae-6cfa-40b9-9b08-75c6d730c102 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.604274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb983ae-6cfa-40b9-9b08-75c6d730c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.627161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2cb983ae-6cfa-40b9-9b08-75c6d730c102 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:10.628520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2cb983ae-6cfa-40b9-9b08-75c6d730c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.636800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1093/2161] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:10.645897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.646248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.649921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.650598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1069/2162] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:10.655072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.656893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.668952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d571d2-d7fd-4de7-b82d-4519c4689d25 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.674683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.675297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.675680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.675946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.676703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.677463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:10.678538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.678729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.690493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1094/2163] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:10.694615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.695304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1070/2164] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:10.696099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.704437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af542-1f29-4bff-af5b-e1d3a8f264f9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.708068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d928-df89-4e0c-a153-f4e0d59a9d50 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.710022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.710679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.710962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.711240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.711900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.714780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.714912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.714991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.714991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.714991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.718910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:10.718910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.718910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.731196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1071/2165] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:10.733722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1095/2166] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:10.736570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.741748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.747670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb29ba1-9d59-4d35-a5d1-2d41bea1f755 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.749291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13839a-e14a-4ff6-a0cb-52affbb511c9 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.753483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.754084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.754308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.754627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.754777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.754918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.755069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.755322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] PATH_INFO: `/v3/projects/01ef9d91d9fb4294aba2e448a1b458a5/users/f38b239e594a4862bb8e28bf10dcb861/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.755532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.757424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.771832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ef9d91d9fb4294aba2e448a1b458a5, user_id=f38b239e594a4862bb8e28bf10dcb861, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.774555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2bcbb-22a3-4fc2-b1b2-5e28f7ffbda4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:10.854755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1072/2167] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:10.857797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1096/2168] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:10 2022] PUT /identity/v3/projects/01ef9d91d9fb4294aba2e448a1b458a5/users/f38b239e594a4862bb8e28bf10dcb861/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:10.859402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:10.870599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.870903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.871532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.895053 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.915310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] MFA Rules not processed for user `f38b239e594a4862bb8e28bf10dcb861`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:10.916523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:10.932687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9fd1-c9b7-42bc-b055-abadcfa064be admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:10.938423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:10.939649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:10.940068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:10.940698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:10.941168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:10.943123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.007790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1073/2169] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:11.010477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1097/2170] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:11.011758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.024767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.029400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:11.034769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4334-4553-4f44-b992-8b68f58c387f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.044256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.046112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.047772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.049285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.050351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.055628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.069021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1074/2171] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:11.072766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.089050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b567a4-f2be-4357-8555-7ec7b960f444 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.095480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.096305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.096691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.097063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.097775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.099700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.104627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791a67-d086-43e7-bd0b-915eb81a6f9a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.108949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.109755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.110323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.110847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.114890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1075/2172] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:11.116594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.129970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.131789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.133270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea7b5-8f76-4084-bc33-aa60391afa5b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.142837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.143737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.144094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.144500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] PATH_INFO: `/v3/projects/a8ad2ef7437444a3943d0063573b7916/users/da8684975f104e8b8e3f5523627f3f44/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.146900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1098/2173] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:11.186744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ad2ef7437444a3943d0063573b7916, user_id=da8684975f104e8b8e3f5523627f3f44, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.189182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa655c9a-7093-408f-b2b8-ec134849726d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.190760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.214192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea3be-5c61-47fa-80e5-b27c3ad4dc9d service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.224790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.225657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.226004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.226291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] PATH_INFO: `/v3/users/f38b239e594a4862bb8e28bf10dcb861` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.227532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38b239e594a4862bb8e28bf10dcb861)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.229716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.259974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.292287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1076/2174] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:11 2022] PUT /identity/v3/projects/a8ad2ef7437444a3943d0063573b7916/users/da8684975f104e8b8e3f5523627f3f44/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:11.298698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.298837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.299088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.327357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] MFA Rules not processed for user `da8684975f104e8b8e3f5523627f3f44`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:11.328447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:11.395946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1077/2175] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:11.407968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.470766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269ed5b-b154-4981-921f-b73ea501c864 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.475993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.477745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.477928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38b239e594a4862bb8e28bf10dcb861'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:11.478338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.478738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.491642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38b239e594a4862bb8e28bf10dcb861'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:11.492695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.493312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38b239e594a4862bb8e28bf10dcb861'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:11.494209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38b239e594a4862bb8e28bf10dcb861'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:11.500284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43ce38-9313-48e9-b3d7-f6c987443350 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.505940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1078/2176] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:11.641388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38b239e594a4862bb8e28bf10dcb861'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:11.659401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1099/2177] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:11 2022] DELETE /identity/v3/users/f38b239e594a4862bb8e28bf10dcb861 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:11.665145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.665437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.665720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.673779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.686575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:11.687804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:11.747286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1079/2178] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:11.757148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:11.758610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:11.818115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112576-fe38-4a32-8fd9-eb9840cb00fe admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:11.822424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:11.823066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:11.823349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:11.823623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:11.833602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:11.839091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9bb4-4b86-4b5f-808f-21f470d4615e service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:11.845307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1100/2179] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:12.319057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.320702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.334098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4729-8c1b-404a-8295-0d85d45f224d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.338973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:12.340104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.340544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.340976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] PATH_INFO: `/v3/projects/01ef9d91d9fb4294aba2e448a1b458a5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.342804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ef9d91d9fb4294aba2e448a1b458a5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:12.345498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:12.473682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ef9d91d9fb4294aba2e448a1b458a5', 'request_id': 'req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.572741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ef9d91d9fb4294aba2e448a1b458a5', 'request_id': 'req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.580576 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ef9d91d9fb4294aba2e448a1b458a5', 'request_id': 'req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.591130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] The token cache is being invalidate because project 01ef9d91d9fb4294aba2e448a1b458a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:12.591359 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.591982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f4b8447f-d4fa-4e2c-928f-23bef430dfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.593872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1080/2180] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:12 2022] DELETE /identity/v3/projects/01ef9d91d9fb4294aba2e448a1b458a5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:12.598840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.599307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.599418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.620930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:12.622192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.681219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1101/2181] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:12.690761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.691084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.691347 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.712642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:12.713915 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.722091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1081/2182] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:12.726473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.737491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904aa9-ca7f-4149-b6ea-f54c67dff0f0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.742699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:12.746155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.746155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.746155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.746155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:12.746155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:12.746569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:12.761315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1102/2183] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:12.765684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.775432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc9c1-9d51-40dc-9894-b50941a2cb89 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.780311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:12.780974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.781258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.781536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.782173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:12.784118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:12.919316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1082/2184] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:12 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:12.924731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.937207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47522-26f2-4b6e-860c-5beca5d8585d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.961901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:12.991774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.993804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.995112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.000831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.000831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.000831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.000831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.000831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.007041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1bb0-09af-412e-b86e-d9621538b839 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.012469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.013106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.013390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.013666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] PATH_INFO: `/v3/users/6f76f6e1f4754ccd8b0773711cb42952` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.015939 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f76f6e1f4754ccd8b0773711cb42952)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.017936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.064405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1103/2185] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:12 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:13.068322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.078586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2804f3f-6831-4d59-a043-c825cd700588 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.083634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.084226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.084509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.084829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.092959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.092959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.098390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1104/2186] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:13.102001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.112379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8615ba-0dab-4b4a-83d8-c05353b155ab admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.117643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.118189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.118572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.118945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.119595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.122041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.134217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1105/2187] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:13.138248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.148788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572511b0-df05-486e-b178-7af1592306f7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.153819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.154519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.154827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.155114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] PATH_INFO: `/v3/projects/5edb0c096a9246069f236d97d0f3e9da/users/0cb7b32e84864011814b0381eda6ce2e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.173081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edb0c096a9246069f236d97d0f3e9da, user_id=0cb7b32e84864011814b0381eda6ce2e, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.176161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a19ee-dd63-4c21-a6ff-c0b97eda5efe admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.182430 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f76f6e1f4754ccd8b0773711cb42952'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.183571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f76f6e1f4754ccd8b0773711cb42952'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.188999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:13.295065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1106/2188] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:13 2022] PUT /identity/v3/projects/5edb0c096a9246069f236d97d0f3e9da/users/0cb7b32e84864011814b0381eda6ce2e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:13.303011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.303011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.303011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.319767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f76f6e1f4754ccd8b0773711cb42952'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.327985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:13.329428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.340925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f76f6e1f4754ccd8b0773711cb42952'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.349777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f4b1ced-2ec4-4716-a1fb-ef3d99e2499a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f76f6e1f4754ccd8b0773711cb42952'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.356550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1083/2189] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:12 2022] DELETE /identity/v3/users/6f76f6e1f4754ccd8b0773711cb42952 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:13.361470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.361761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.366689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.397330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:13.398627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.415893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1107/2190] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:13.432430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.434607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.555433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1084/2191] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:13.574227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.577434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.584868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2da1e-4ca1-419c-823f-e70039bbe35c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.652939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:13.695330 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdee7-28bc-4390-bd42-f42e30082ef9 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.700172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.700478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.700758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.701102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.701633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.703017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.703885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.704460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.713043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.716711 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.719024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.731334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1108/2192] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:13.733417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d44f5-7939-4c6c-84ed-712858878be5 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.761554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1085/2193] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:14.775484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.782062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:14.807040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed65a8-6ff8-4bf9-a9e6-9afb5b9656ed service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.827243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.828553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.829004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.829437 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] PATH_INFO: `/v3/projects/0fc02aed164646cab75dfec1e96710de` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.831574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc02aed164646cab75dfec1e96710de)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.834217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.025612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc02aed164646cab75dfec1e96710de', 'request_id': 'req-828e0493-f599-44d4-b5eb-efe18d62b9fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:15.166843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc02aed164646cab75dfec1e96710de', 'request_id': 'req-828e0493-f599-44d4-b5eb-efe18d62b9fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:15.175582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc02aed164646cab75dfec1e96710de', 'request_id': 'req-828e0493-f599-44d4-b5eb-efe18d62b9fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:15.188515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] The token cache is being invalidate because project 0fc02aed164646cab75dfec1e96710de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:15.188892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:15.189662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-828e0493-f599-44d4-b5eb-efe18d62b9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:15.191270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1109/2194] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:14 2022] DELETE /identity/v3/projects/0fc02aed164646cab75dfec1e96710de => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:15.197073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.197972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.198260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.231241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:15.233490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:15.332529 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1086/2195] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:15.336313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.336792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.337249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.376624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:15.378028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:15.405192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1110/2196] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:15.409531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.421061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4fb52-b814-4d90-964a-6e8b3fd3459c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.445457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.446100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.449024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.449024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.449024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:15.449024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.457833 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.499178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:15.509125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1087/2197] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:58:15.510403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.520842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5d9a-0f89-4c59-ba8c-7a6b1ac05fca None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.526177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.526854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.527147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.527423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.528088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.534703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.686283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1111/2198] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:15.690090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.704161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfc2ee-7d0a-424f-a6bc-26f46497352c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.780873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.781622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.781821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.782126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.782982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.785015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.887399 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1088/2199] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:15.892106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.904114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325361-0c37-4481-aa53-8cff8f1f9ad5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.910870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.912118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.912417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.912697 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.913460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.915270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.928986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1112/2200] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:15.933609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.965329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e9d21-b26d-4cda-b4a3-55d5f4fe07c1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.965329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.965329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.965329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.965817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.965817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.965817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a8077-fe5a-444b-bf4d-a5924cdd6e9c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.976755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1089/2201] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:15.980949 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.991681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3064b2-f8bb-4e1e-aac0-1ddbb4c81891 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.997280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.998152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.998953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.999322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] PATH_INFO: `/v3/projects/8e535016a4dd415fa41925eb9f0bb800/users/875253f283ad46f1bc77596a3c27c6f3/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.016374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e535016a4dd415fa41925eb9f0bb800, user_id=875253f283ad46f1bc77596a3c27c6f3, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:16.019111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:16.127154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1113/2202] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:15 2022] PUT /identity/v3/projects/8e535016a4dd415fa41925eb9f0bb800/users/875253f283ad46f1bc77596a3c27c6f3/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:16.137769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:16.138874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:16.138874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.204860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] MFA Rules not processed for user `875253f283ad46f1bc77596a3c27c6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:16.206135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:16.327339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1090/2203] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:16.327489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:16.393101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:16.413208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b1b6-bc77-4d75-a511-8497e47b934c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:16.421935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:16.423599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:16.424060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:16.424490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.426109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:16.429409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:16.549070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1114/2204] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:16 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:16.553409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:16.568897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286ce7-e00f-4295-b027-b4cead888506 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:16.645407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:16.646049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:16.646323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:16.646634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.647270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:16.649254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:16.790565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:16.802348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1091/2205] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:16 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:16.806464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:16.818658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae27b3e-12c0-452a-aa38-4380e76ea2b0 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:16.823787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:16.824476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:16.824824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:16.825186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.827100 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:16.828048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:16.839684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1115/2206] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:16.844237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:16.855334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8189589-660d-4d2e-af0a-32b3eab85f4a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:16.862633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:16.866349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:16.866349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:16.866349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] PATH_INFO: `/v3/projects/684ffe55194f489788e8a3a958e385ea/users/b59df8167a6b4a77bc49850b8eefc2ca/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:16.883666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684ffe55194f489788e8a3a958e385ea, user_id=b59df8167a6b4a77bc49850b8eefc2ca, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:16.887764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:17.004786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1092/2207] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:16 2022] PUT /identity/v3/projects/684ffe55194f489788e8a3a958e385ea/users/b59df8167a6b4a77bc49850b8eefc2ca/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:17.005478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:17.031563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be797a-e0c9-4620-afee-7d9aa23469dd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:17.096089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:17.096888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:17.097175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:17.097481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:17.098133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:17.099828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d851-f357-4ffa-92ad-c84733f719f7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:17.113615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1116/2208] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:17.115066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:17.126497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf17dff-df5f-4302-9c3a-d382b642b860 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:17.131264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:17.132087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:17.132514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:17.133250 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] PATH_INFO: `/v3/projects/684ffe55194f489788e8a3a958e385ea/users/b59df8167a6b4a77bc49850b8eefc2ca/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:17.135369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684ffe55194f489788e8a3a958e385ea, user_id=b59df8167a6b4a77bc49850b8eefc2ca, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:17.138150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:17.152709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1093/2209] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:17 2022] PUT /identity/v3/projects/684ffe55194f489788e8a3a958e385ea/users/b59df8167a6b4a77bc49850b8eefc2ca/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:17.171720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379c03-b429-4ea3-bc8f-d946b321bea3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:17.172134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379c03-b429-4ea3-bc8f-d946b321bea3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:17.172481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379c03-b429-4ea3-bc8f-d946b321bea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:17.245277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6e379c03-b429-4ea3-bc8f-d946b321bea3 None None] MFA Rules not processed for user `b59df8167a6b4a77bc49850b8eefc2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:17.245277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6e379c03-b429-4ea3-bc8f-d946b321bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:17.357930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1117/2210] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:17.366490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:17.369446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:17.504159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0d48-028e-406b-b559-77dc8c028c43 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:17.524400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:17.525775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:17.526237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:17.526719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:17.618812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:17.621679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:17.633527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1094/2211] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:22.238611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:22.239915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:22.239915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:22.265784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:22.267785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:22.331432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:22.358370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1118/2212] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:22.428143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:22.433738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:22.596245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b55f4-a7a9-4471-9bed-edc296076adb service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:22.602405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:22.603097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:22.603385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:22.603716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:22.613580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:22.615442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827111-abfe-4122-80d5-342304f0cc19 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:22.625674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1095/2213] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:23.129219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:23.218594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bf8f-777f-4899-a528-9fa153541d2a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:23.224229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:23.225012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:23.225306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:23.225658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] PATH_INFO: `/v3/users/875253f283ad46f1bc77596a3c27c6f3` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:23.226981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=875253f283ad46f1bc77596a3c27c6f3)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:23.229891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:23.491906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875253f283ad46f1bc77596a3c27c6f3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:23.509684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875253f283ad46f1bc77596a3c27c6f3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:23.510947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875253f283ad46f1bc77596a3c27c6f3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:23.511819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875253f283ad46f1bc77596a3c27c6f3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:23.608556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3510cd67-0514-4410-8f58-b46a6935b96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875253f283ad46f1bc77596a3c27c6f3'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:23.635870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1119/2214] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:23 2022] DELETE /identity/v3/users/875253f283ad46f1bc77596a3c27c6f3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:23.641127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:23.641604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:23.643528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:23.654580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:23.685350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:23.688873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:23.771149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684028a-9461-4e60-944b-b711d838042d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:23.771149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684028a-9461-4e60-944b-b711d838042d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:23.771442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684028a-9461-4e60-944b-b711d838042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:23.807150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1096/2215] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:23.837659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b684028a-9461-4e60-944b-b711d838042d None None] MFA Rules not processed for user `0cb7b32e84864011814b0381eda6ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:23.839290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b684028a-9461-4e60-944b-b711d838042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:23.843784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:23.845528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:23.999313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498ffa6-7c0b-40d5-888d-d154b2432a3d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.011114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.011906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.012319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.012789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.028524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.030258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:24.085317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1097/2216] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:24.131153 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:24.166425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1120/2217] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:24.172842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.172842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:24.220535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed0b1-61a8-4ed2-8957-3c1f2984d1bd service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.256424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.257109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.257387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.257665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.258343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.260268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:24.438104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1098/2218] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:24.439687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684028a-9461-4e60-944b-b711d838042d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.499158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684028a-9461-4e60-944b-b711d838042d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.651103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.651925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.652322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.652708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.654286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.656295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:24.755824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1121/2219] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:24 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:24.761115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.791560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8725d4-a816-41b1-b2c8-05e65287b0a2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.817288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.817539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.817887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.818170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.818962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.821121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:24.852032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1099/2220] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:24.859939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.891443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84c56-34fb-487d-bfb9-425b01a766dc admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.907377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.908334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.908687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.908989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] PATH_INFO: `/v3/projects/56111c836ae94d70a6b00cc91243f125/users/1dd5627006334a03b439267698f8fa89/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.954356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56111c836ae94d70a6b00cc91243f125, user_id=1dd5627006334a03b439267698f8fa89, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.964408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.096423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.097215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:25.101644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1122/2221] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:24 2022] PUT /identity/v3/projects/56111c836ae94d70a6b00cc91243f125/users/1dd5627006334a03b439267698f8fa89/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:25.112461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.133668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86feb6-712a-4f64-ad49-4e4db466480e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.232403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.233615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.234346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.235179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] PATH_INFO: `/v3/projects/8e535016a4dd415fa41925eb9f0bb800` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.236824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e535016a4dd415fa41925eb9f0bb800)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.240360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.253060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85648c1-346d-41d2-9527-50675836ff47 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.258893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.259814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.260166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.260506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.261304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.264021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.268523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:25.280168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1123/2222] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:25.284524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.311929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21af950-8513-441e-9e4f-659c0e9343d8 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.323188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.324281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.324945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.326020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] PATH_INFO: `/v3/projects/56111c836ae94d70a6b00cc91243f125/users/1dd5627006334a03b439267698f8fa89/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.328919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56111c836ae94d70a6b00cc91243f125, user_id=1dd5627006334a03b439267698f8fa89, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.335621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.345994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1124/2223] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:25 2022] PUT /identity/v3/projects/56111c836ae94d70a6b00cc91243f125/users/1dd5627006334a03b439267698f8fa89/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:25.431585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e535016a4dd415fa41925eb9f0bb800', 'request_id': 'req-7df8447c-de37-4007-bd14-861d94d43a83'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.502550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e535016a4dd415fa41925eb9f0bb800', 'request_id': 'req-7df8447c-de37-4007-bd14-861d94d43a83'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.512263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e535016a4dd415fa41925eb9f0bb800', 'request_id': 'req-7df8447c-de37-4007-bd14-861d94d43a83'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.552012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] The token cache is being invalidate because project 8e535016a4dd415fa41925eb9f0bb800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:25.552219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.553677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.564045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:25.568863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.577965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1100/2224] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:25 2022] DELETE /identity/v3/projects/8e535016a4dd415fa41925eb9f0bb800 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:25.581670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.586262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:25.664678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:25.693174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a107a0-3f02-4ef0-bb68-e67c2f61bcd1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.829929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8447c-de37-4007-bd14-861d94d43a83 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.855124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.855790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.856114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.856479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] PATH_INFO: `/v3/users/b59df8167a6b4a77bc49850b8eefc2ca` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.859187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59df8167a6b4a77bc49850b8eefc2ca)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.865561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.947434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.948215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.948609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.948896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] PATH_INFO: `/v3/users/da8684975f104e8b8e3f5523627f3f44` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.958007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8684975f104e8b8e3f5523627f3f44)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.962828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:26.222994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59df8167a6b4a77bc49850b8eefc2ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.225497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59df8167a6b4a77bc49850b8eefc2ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.280150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8684975f104e8b8e3f5523627f3f44'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.304904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8684975f104e8b8e3f5523627f3f44'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.306034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8684975f104e8b8e3f5523627f3f44'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.306857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8684975f104e8b8e3f5523627f3f44'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.318550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59df8167a6b4a77bc49850b8eefc2ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.355824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59df8167a6b4a77bc49850b8eefc2ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.377468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3955e662-6155-4e74-9134-1bd1825b254f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59df8167a6b4a77bc49850b8eefc2ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.395853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1101/2225] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:25 2022] DELETE /identity/v3/users/b59df8167a6b4a77bc49850b8eefc2ca => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:26.445851 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8684975f104e8b8e3f5523627f3f44'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.471057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1125/2226] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:25 2022] DELETE /identity/v3/users/da8684975f104e8b8e3f5523627f3f44 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:26.475316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d6c1-82e8-4ac7-af36-73cfe98d242b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:26.475602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d6c1-82e8-4ac7-af36-73cfe98d242b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:26.476065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d6c1-82e8-4ac7-af36-73cfe98d242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:26.503165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0ea0d6c1-82e8-4ac7-af36-73cfe98d242b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:26.504773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0ea0d6c1-82e8-4ac7-af36-73cfe98d242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:26.550252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:26.670999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1102/2227] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:26.699053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:26.701878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:26.823634 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8119-a5e6-45de-8b7b-79361584bda1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:26.824345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8119-a5e6-45de-8b7b-79361584bda1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:26.825071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8119-a5e6-45de-8b7b-79361584bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:26.878542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a8fe8119-a5e6-45de-8b7b-79361584bda1 None None] MFA Rules not processed for user `6188ad0d16f1411a953693c9a29dceb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:26.884046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a8fe8119-a5e6-45de-8b7b-79361584bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:26.916199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bd77-d3bf-4148-bc58-3e1cbcc00d2f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:26.933243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:26.933583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:26.933704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:26.934207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:26.974513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:26.974761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:27.004001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1126/2228] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:27.026083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1103/2229] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:27.328135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:27.329703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.360919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01edde-c5cf-4a8e-a93e-48d318afd781 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:27.372791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:27.376522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.377063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.378478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] PATH_INFO: `/v3/projects/684ffe55194f489788e8a3a958e385ea` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.384028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=684ffe55194f489788e8a3a958e385ea)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:27.386508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:27.411875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:27.567905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684ffe55194f489788e8a3a958e385ea', 'request_id': 'req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.651360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684ffe55194f489788e8a3a958e385ea', 'request_id': 'req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.658718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684ffe55194f489788e8a3a958e385ea', 'request_id': 'req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.690594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] The token cache is being invalidate because project 684ffe55194f489788e8a3a958e385ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:27.691171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.692642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cd8d26c0-fde8-4a55-9597-b954e1eee1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.695537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1127/2230] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:27 2022] DELETE /identity/v3/projects/684ffe55194f489788e8a3a958e385ea => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:27.700902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.701424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.701762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.744320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:27.746280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.891980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1104/2231] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:27.901005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.901490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.901588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.933723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:27.935021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.947002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1128/2232] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:27.948178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:27.972800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b219af-c168-4bf8-a6b5-7f34d722bb35 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:27.991287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.004874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.022497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1105/2233] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:28.024476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.037593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a428-a4e8-43e0-a6a8-aa9d437a7510 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.044569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.045753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.046381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.047003 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.047992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.050637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.162946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1129/2234] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:28.167722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.183811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7ac5-c08a-47ca-8d3c-31e2634153fe admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.251556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.252692 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:28.312230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:28.332367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.332367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.332367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.332367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.334142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.339108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.464648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de968ee-3477-4df5-a42a-fb9a65d3ecc4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.474238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.475126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.475668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.476310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] PATH_INFO: `/v3/projects/a8ad2ef7437444a3943d0063573b7916` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.478237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ad2ef7437444a3943d0063573b7916)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.480832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.553762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1106/2235] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/users => generated 284 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:28.559191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.640190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57164-33eb-4b9e-9bb7-4a4e59e194d4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.640190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.640190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.640190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.640658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.640658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.640658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.668212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1107/2236] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:28.669420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.699177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efac9-5ea5-4ee0-941d-0fd2ce94b067 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.734058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.735391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.736195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.736877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.739658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.742945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.753829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ad2ef7437444a3943d0063573b7916', 'request_id': 'req-65b15208-aed8-4b24-ab99-b9c3b38154c2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.767986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1108/2237] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:28.770044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.797595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90d8c-0591-4b70-8fa7-5107a63c305e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.841621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ad2ef7437444a3943d0063573b7916', 'request_id': 'req-65b15208-aed8-4b24-ab99-b9c3b38154c2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.849393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ad2ef7437444a3943d0063573b7916', 'request_id': 'req-65b15208-aed8-4b24-ab99-b9c3b38154c2'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.894259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:28.913162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] The token cache is being invalidate because project a8ad2ef7437444a3943d0063573b7916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:28.913853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.923145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-65b15208-aed8-4b24-ab99-b9c3b38154c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.945449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1130/2238] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:28 2022] DELETE /identity/v3/projects/a8ad2ef7437444a3943d0063573b7916 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:29.097900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.100025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.100341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.100616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] PATH_INFO: `/v3/projects/1306c1de931b4dc8bba58cc630d78b37/users/73a54cca1ee248ed83c2908c66b339dd/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.171192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1306c1de931b4dc8bba58cc630d78b37, user_id=73a54cca1ee248ed83c2908c66b339dd, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.184276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.331391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1109/2239] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:28 2022] PUT /identity/v3/projects/1306c1de931b4dc8bba58cc630d78b37/users/73a54cca1ee248ed83c2908c66b339dd/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:29.342105 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd472c-4d43-4f7f-9ecb-0e1b899359b8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.342757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd472c-4d43-4f7f-9ecb-0e1b899359b8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.343270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd472c-4d43-4f7f-9ecb-0e1b899359b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.411637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-2dcd472c-4d43-4f7f-9ecb-0e1b899359b8 None None] MFA Rules not processed for user `73a54cca1ee248ed83c2908c66b339dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:29.412980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-2dcd472c-4d43-4f7f-9ecb-0e1b899359b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:29.647032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1131/2240] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:29.660502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:29.662215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:29.773713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03852-150d-43b4-b919-e3d73073b37a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.783834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.784474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.784756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.785037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.799028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.800758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.821434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1110/2241] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:38.846151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72637f5-5d0d-4c04-a957-3f2426809f0e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:38.846637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72637f5-5d0d-4c04-a957-3f2426809f0e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:38.846812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72637f5-5d0d-4c04-a957-3f2426809f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:38.880323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d72637f5-5d0d-4c04-a957-3f2426809f0e None None] MFA Rules not processed for user `1dd5627006334a03b439267698f8fa89`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:38.881583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d72637f5-5d0d-4c04-a957-3f2426809f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:39.022068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1132/2242] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:39.806971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=73,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:48.764255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:48.778473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320afd-9211-4939-8da9-36b49dc370d8 service glance] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:48.784173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:48.785702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:48.786094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:48.786497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:48.794745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:48.874436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:48.875881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:48.885401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1111/2243] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:49.011351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=66 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:49.158301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde33b-009e-49f2-99e8-2cd56dad32e5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:49.159121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde33b-009e-49f2-99e8-2cd56dad32e5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:49.159234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde33b-009e-49f2-99e8-2cd56dad32e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:49.186609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-cbdde33b-009e-49f2-99e8-2cd56dad32e5 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:49.188178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cbdde33b-009e-49f2-99e8-2cd56dad32e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:49.257067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1133/2244] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:49.270583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:49.272331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:49.352912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53379-4cdc-4d84-ab69-1b6d4a002d09 service glance] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:49.359539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:49.360169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:49.360441 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:49.360716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:49.369922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:49.372454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:49.382321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1112/2245] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:53.110302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.114865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.114865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.131544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:53.133040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:53.146736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1134/2246] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:53.161506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:53.175789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5f6-9d88-4a7f-be84-16bbefe5491a service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:53.181544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:53.182158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.184982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.184982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.196102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:53.197849 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:53.211951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1113/2247] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:58:56.753327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:56.754954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:56.847744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01fd08-47f8-4600-a93a-6e7a532c4de3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:56.861287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:56.862026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:56.862373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:56.862789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] PATH_INFO: `/v3/users/bbeefc854555412ca111941542da21b4` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:56.864268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeefc854555412ca111941542da21b4)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:56.866252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:57.037733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeefc854555412ca111941542da21b4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.054926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeefc854555412ca111941542da21b4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.055981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeefc854555412ca111941542da21b4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.056754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeefc854555412ca111941542da21b4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.111721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7d67c380-77df-4f4c-825c-45b3eba915a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeefc854555412ca111941542da21b4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.128632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1135/2248] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:56 2022] DELETE /identity/v3/users/bbeefc854555412ca111941542da21b4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:57.412654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:57.440792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadb58b-6e70-40ee-99df-5a0eaa8f6f92 service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:57.522414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:57.523562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:57.523913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:57.524257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] PATH_INFO: `/v3/projects/d480c86433ed400fabf7b30eebb6d169` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:57.525663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d480c86433ed400fabf7b30eebb6d169)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:57.528073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:57.555470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:57.704462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd480c86433ed400fabf7b30eebb6d169', 'request_id': 'req-2943840b-97b9-48ae-a2d7-935409cfd046'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.792215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd480c86433ed400fabf7b30eebb6d169', 'request_id': 'req-2943840b-97b9-48ae-a2d7-935409cfd046'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.804171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd480c86433ed400fabf7b30eebb6d169', 'request_id': 'req-2943840b-97b9-48ae-a2d7-935409cfd046'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.831749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] The token cache is being invalidate because project d480c86433ed400fabf7b30eebb6d169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:57.832091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.834383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-2943840b-97b9-48ae-a2d7-935409cfd046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:57.836666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1114/2249] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:57 2022] DELETE /identity/v3/projects/d480c86433ed400fabf7b30eebb6d169 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:01.012046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:01.012526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:01.012617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:01.035316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] MFA Rules not processed for user `0cb7b32e84864011814b0381eda6ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:01.035316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:01.046567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.091690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1136/2250] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:05.101411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:05.102667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:05.102952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:05.130047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:05.131837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:05.209510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1115/2251] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:05.218921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:05.220384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:05.299744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c363d2-1d9f-48f1-a2c0-3ebdc0e84672 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:05.304924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:05.305689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:05.305975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:05.306248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:05.315861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:05.317627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ccd87-0905-4a87-9916-396a4e340a90 service swift] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:05.326826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1137/2252] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:59:09.944763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:09.946223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:10.021175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2589-d1d5-4680-8e1b-540bc3809bd2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:10.027026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:10.027669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:10.027948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:10.028219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] PATH_INFO: `/v3/users/73a54cca1ee248ed83c2908c66b339dd` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:10.029379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a54cca1ee248ed83c2908c66b339dd)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:10.031466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:10.231362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a54cca1ee248ed83c2908c66b339dd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:10.237420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a54cca1ee248ed83c2908c66b339dd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:10.237420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:10.293548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a54cca1ee248ed83c2908c66b339dd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:10.308260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a54cca1ee248ed83c2908c66b339dd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:10.319493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a54cca1ee248ed83c2908c66b339dd'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:10.326046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1116/2253] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:59:09 2022] DELETE /identity/v3/users/73a54cca1ee248ed83c2908c66b339dd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:10.331366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:10.331921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:10.332034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:10.354156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:10.355591 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:10.442733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1138/2254] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:10.452828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:10.454267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:10.531354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80843-a4b4-48a6-951c-d621f93c685d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:10.535085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:10.538066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:10.538066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:10.538066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:10.546265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:10.547757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b01f6-1bf7-4bc5-a83b-01ff4f5c087c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:10.558300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1117/2255] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:11.037796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.039932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:11.073486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2a71-63e8-4ac1-b895-4d8b9cbe23b6 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.087631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.089227 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.089532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.089809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] PATH_INFO: `/v3/projects/1306c1de931b4dc8bba58cc630d78b37` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.091079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1306c1de931b4dc8bba58cc630d78b37)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.093096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.200600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:11.202874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1306c1de931b4dc8bba58cc630d78b37', 'request_id': 'req-dab531b6-0815-4f91-b979-f8e4944e2110'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:11.293946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1306c1de931b4dc8bba58cc630d78b37', 'request_id': 'req-dab531b6-0815-4f91-b979-f8e4944e2110'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:11.301551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1306c1de931b4dc8bba58cc630d78b37', 'request_id': 'req-dab531b6-0815-4f91-b979-f8e4944e2110'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:11.315925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] The token cache is being invalidate because project 1306c1de931b4dc8bba58cc630d78b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:59:11.316550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:11.316875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-dab531b6-0815-4f91-b979-f8e4944e2110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:11.318608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1139/2256] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:59:11 2022] DELETE /identity/v3/projects/1306c1de931b4dc8bba58cc630d78b37 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:11.323601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.324142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.324142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.350480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:11.351787 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:11.413262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1118/2257] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:11.423083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.423565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.423565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.445136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:11.446424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:11.455619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1140/2258] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:11.460034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.473331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf87df-4100-4a19-a376-aab916f0c0e5 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.480730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.481364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.481641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.481908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.482633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:59:11.482935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.484620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.497229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1119/2259] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:59:11.502761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.512854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1fe53-c2ec-45c8-b791-3e1fbe843eb1 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.522752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.522752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.522752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.522752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.523129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.523129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.611557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1141/2260] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:59:11 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:59:11.616333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.628332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41be49-65fc-4425-997c-89745a6541df admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.697782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.698333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.698690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.698969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.699647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.701590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.709731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:11.763506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1120/2261] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:59:11 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:59:11.767643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.779090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec42afa-ee8f-46df-855b-aaedf4cc6415 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.783757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.784392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.784699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.793561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.794316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.796011 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.807332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1142/2262] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:59:11.815836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.826306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5301e3-5c08-4a3f-817b-201f0af2eb4a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.831066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.831674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.831951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.832220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.832863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.834488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4df12-29c5-4ede-b8ce-67b40346e878 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.849751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1121/2263] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:59:11.850953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:11.861582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dcd0a-09a6-44a6-8f35-a4900d6bda2a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:11.866966 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:11.867846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.868130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.868406 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] PATH_INFO: `/v3/projects/f4e4e6a6979a43eb83f852b61f5db9dc/users/1d771088800546acbb9fec980088f1a0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:11.883831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e4e6a6979a43eb83f852b61f5db9dc, user_id=1d771088800546acbb9fec980088f1a0, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:11.887106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:11.962906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1143/2264] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:59:11 2022] PUT /identity/v3/projects/f4e4e6a6979a43eb83f852b61f5db9dc/users/1d771088800546acbb9fec980088f1a0/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:11.973706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e223-2a6f-4b41-ad5f-36857279c336 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:11.981497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e223-2a6f-4b41-ad5f-36857279c336 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:11.981497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e223-2a6f-4b41-ad5f-36857279c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:12.003974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-de49e223-2a6f-4b41-ad5f-36857279c336 None None] MFA Rules not processed for user `1d771088800546acbb9fec980088f1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:12.005425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-de49e223-2a6f-4b41-ad5f-36857279c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:12.088602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1122/2265] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:12.095823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:12.097533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:12.164174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea86f-dac4-497c-9696-868807f03ca9 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:12.168156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:12.168782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:12.169064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:12.169341 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:12.178320 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:12.179790 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6816977-21a7-468d-b0c0-cdd120f0a99c service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:12.189622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1144/2266] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:18.939422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15dca-1acc-4032-a7a1-76a766a1b213 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:18.939909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15dca-1acc-4032-a7a1-76a766a1b213 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:18.940096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15dca-1acc-4032-a7a1-76a766a1b213 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:18.941482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1123/2267] 10.222.0.47 () {54 vars in 961 bytes} [Tue Aug 30 14:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:59:18.947417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d1ec-3226-4752-98cb-73fc05d4449f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:18.947953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d1ec-3226-4752-98cb-73fc05d4449f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:18.948458 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06d1ec-3226-4752-98cb-73fc05d4449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:18.970463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6a06d1ec-3226-4752-98cb-73fc05d4449f None None] MFA Rules not processed for user `0b8ff6d1bfd44ec08cef4f0039e1aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:18.971753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6a06d1ec-3226-4752-98cb-73fc05d4449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:19.034873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1145/2268] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Aug 30 14:59:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:19.042526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15dca-1acc-4032-a7a1-76a766a1b213 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:19.056593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15dca-1acc-4032-a7a1-76a766a1b213 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:19.061585 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:19.062176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:19.062600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:19.062875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:19.064575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:19.076675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:19.078323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:19.088821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1124/2269] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:21.466278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:21.466783 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:21.467021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:21.487376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:21.488842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:21.495992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:21.552063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1146/2270] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:21.565357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:21.567084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:21.650401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81495e-25c7-47f4-a378-4770dd14f9f1 service placement] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:21.656239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:21.656909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:21.657193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:21.657468 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:21.666085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:21.667779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42401-96a2-4e7a-9afd-5a711ea153a2 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:21.676555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1125/2271] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:59:31.675608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=3,keystone:SELECT=77 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:31.733136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=20 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:37.060466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:37.061950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:37.120559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c19e-a01a-4519-b6f6-02cbdf2635a1 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:37.125825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:37.126432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:37.126739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:37.127014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:37.128734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:37.190906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:37.192326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a40f09-e503-46be-8d66-a6c585817376 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:37.203246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1147/2272] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:42.197000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.197000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.197000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.197000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1126/2273] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:59:42.204016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba372-523b-4866-b84e-7a6088ded952 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.204532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba372-523b-4866-b84e-7a6088ded952 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.204784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba372-523b-4866-b84e-7a6088ded952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.224760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-860ba372-523b-4866-b84e-7a6088ded952 None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:42.226175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-860ba372-523b-4866-b84e-7a6088ded952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.308498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1148/2274] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:42.322997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:42.324654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.408462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eb20f-4fd1-4567-a584-39a45f725cea None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:42.412412 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '914aa57ca54b416080fec74e374bac86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:42.413039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.413325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.413602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.427382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:42.428957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453998c-285b-419d-9c82-4afaf29ca3dc service glance] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:42.441163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1127/2275] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:42.707688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7e89-0b41-4fa9-be18-99fef62d02df None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.707985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7e89-0b41-4fa9-be18-99fef62d02df None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.708280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7e89-0b41-4fa9-be18-99fef62d02df None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.709813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1149/2276] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:59:42.714183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e71f-bb42-4810-8981-efcb83d5c7d0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.714490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e71f-bb42-4810-8981-efcb83d5c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.714954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e71f-bb42-4810-8981-efcb83d5c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.715718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.716523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.716867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.735744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b0c6e71f-bb42-4810-8981-efcb83d5c7d0 None None] MFA Rules not processed for user `d04625404c4344bf9d1f11bc14ff69da`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:42.736965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b0c6e71f-bb42-4810-8981-efcb83d5c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.737221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:42.738732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.746256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1150/2277] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:42.760128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:42.761539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.775777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8409e-025c-41e2-9fa2-822e55883fa7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:42.781405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:42.782297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.782672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.782970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.792334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:42.793862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7a64-e466-423d-bf72-0fa689c9bda4 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:42.797843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1128/2278] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:42.805166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1151/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:59:42.912874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357b8e-076d-4140-9b8e-801a3b02bd31 None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.913201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357b8e-076d-4140-9b8e-801a3b02bd31 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.913508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357b8e-076d-4140-9b8e-801a3b02bd31 None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.914941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1129/2280] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:59:42.922433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438024-5889-421f-b177-976ea7e15ea0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.922433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438024-5889-421f-b177-976ea7e15ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.922433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438024-5889-421f-b177-976ea7e15ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:42.943486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a7438024-5889-421f-b177-976ea7e15ea0 None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:42.944744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a7438024-5889-421f-b177-976ea7e15ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:42.957483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1152/2281] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:42.970355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67357b8e-076d-4140-9b8e-801a3b02bd31 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:42.986562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67357b8e-076d-4140-9b8e-801a3b02bd31 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:42.991284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:42.992022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:42.992299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:42.994505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:43.009005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:43.011476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:43.024863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1130/2282] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:59:48.946336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:48.946864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:48.950250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:48.969034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:48.970275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:48.977563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1153/2283] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:48.995538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:49.010366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2faecb-2cd2-4a55-887a-ed4b7c7f7f0f service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:49.017254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:49.017946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:49.018235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:49.018543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:49.027603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:49.029629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be2087-7c11-450c-8391-ce589d67c2e5 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:49.038807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1131/2284] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 14:59:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:59:51.188170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:51.198337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:51.258700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff41aa-ba52-408c-b8a7-1484977429a0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:51.263499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:51.264159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:51.265047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:51.265339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] PATH_INFO: `/v3/users/1d771088800546acbb9fec980088f1a0` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:51.266870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d771088800546acbb9fec980088f1a0)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:51.272324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:51.469254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d771088800546acbb9fec980088f1a0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:51.494471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d771088800546acbb9fec980088f1a0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:51.495516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d771088800546acbb9fec980088f1a0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:51.496312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d771088800546acbb9fec980088f1a0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:51.587230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d771088800546acbb9fec980088f1a0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:51.621410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1154/2285] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 14:59:51 2022] DELETE /identity/v3/users/1d771088800546acbb9fec980088f1a0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:51.625072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:51.625747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:51.625989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:51.652009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:51.653385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:51.742307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1132/2286] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:51.757623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:51.759461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:51.849521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6549-e58e-46e2-885c-0f8eebddd036 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:51.855474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:51.856112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:51.856398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:51.856674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:51.869491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:51.871256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d962cd-03af-4f35-a983-6614b93c508a service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:51.883380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1155/2287] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:52.998639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.000898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:53.034139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466313b1-ce01-48ef-a2e2-59aad4653609 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.049062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.054830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.055443 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.055922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] PATH_INFO: `/v3/projects/f4e4e6a6979a43eb83f852b61f5db9dc` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.057609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e4e6a6979a43eb83f852b61f5db9dc)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.060066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.086481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:53.201720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e4e6a6979a43eb83f852b61f5db9dc', 'request_id': 'req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:53.278928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e4e6a6979a43eb83f852b61f5db9dc', 'request_id': 'req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:53.287096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e4e6a6979a43eb83f852b61f5db9dc', 'request_id': 'req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:53.305180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] The token cache is being invalidate because project f4e4e6a6979a43eb83f852b61f5db9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:59:53.305491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:53.306158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4522cf9e-f9c7-4be8-98ca-e4e25b738d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:59:53.307861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1133/2288] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 14:59:52 2022] DELETE /identity/v3/projects/f4e4e6a6979a43eb83f852b61f5db9dc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:53.313255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.316097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.316097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.335324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:53.336620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:53.371978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:53.409133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1156/2289] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:59:53.480090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.483973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.483973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.502613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:53.503854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:53.512273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1134/2290] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:59:53.517547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.527914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f5fc-c005-4ddf-a6d5-c5277b74e53e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.533978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.534645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.535026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.535354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.536109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:59:53.536474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.538122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.555415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1157/2291] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 14:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:59:53.556725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.568056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910de9f0-e5d8-4731-9516-c23ebef2f05d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.573493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.574336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.574726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.575080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.575835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.578037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.710679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1135/2292] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 14:59:53 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:59:53.714986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.727050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0b01-ec2e-439d-bf09-e8a11f33e5dd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.814668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.815209 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.815494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.815767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.816407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.818504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.898124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1158/2293] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 14:59:53 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:59:53.902517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.919491 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d21f17-010e-4f8d-bf59-8422d290b15d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.925929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.926892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.927397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.927858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.928719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.930962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.963819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:53.964189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1136/2294] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:59:53.978145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc2cf-81e4-4362-bb1f-2209d106c8c7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:53.983008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:53.986619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:53.986619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:53.986619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:53.986619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:53.987258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d30b6-4707-4327-99f7-65e9210190ab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:53.998709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1159/2295] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 14:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:59:54.003457 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:54.013922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74d42-bf53-44ac-bf9e-46c63c770f95 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:54.019453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:54.026329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:54.026329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:54.026329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] PATH_INFO: `/v3/projects/f64dacf23ef44e6db4fbddf3cf41b8e3/users/3f53373c293d4766815306b616c8e241/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:54.038589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64dacf23ef44e6db4fbddf3cf41b8e3, user_id=3f53373c293d4766815306b616c8e241, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:54.041423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:54.141631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1137/2296] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 14:59:54 2022] PUT /identity/v3/projects/f64dacf23ef44e6db4fbddf3cf41b8e3/users/3f53373c293d4766815306b616c8e241/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:59:54.143571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276840-f431-40ce-bd7e-3518905d2023 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:54.143861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276840-f431-40ce-bd7e-3518905d2023 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:54.144120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276840-f431-40ce-bd7e-3518905d2023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:54.189010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8c276840-f431-40ce-bd7e-3518905d2023 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:54.190265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8c276840-f431-40ce-bd7e-3518905d2023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:54.301675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1160/2297] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:54.313045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:54.315188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:54.409638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1495-d751-493f-84c8-e7616c2a89a1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:54.413542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:54.414163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:54.419795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:54.419795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:54.425369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:54.426899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:54.441066 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1138/2298] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:00:00.711676 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:00.712268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:00.712268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:00.765148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] MFA Rules not processed for user `3f53373c293d4766815306b616c8e241`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:00.768411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:00.800499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:00.870736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1161/2299] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:00.872068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:00.894189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9843cc-283a-4c41-a3a8-aca8efea29de service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:00.899400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:00.900026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:00.900307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:00.900581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:00.901222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:00.903166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.019835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1139/2300] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:00:00 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:00:01.024249 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:01.036292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f678-2669-4746-8bf3-b8fd92f50387 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:01.093553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:01.094844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:01.095136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:01.095415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:01.096753 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:01.098759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.178101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1162/2301] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:00:01 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:00:01.182028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:01.192859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d097c4-ab67-4b5b-96a9-d946eacc0be6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:01.197479 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:01.198082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:01.198366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:01.198677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:01.199321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:01.200912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.212484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1140/2302] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:00:01.216821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:01.227615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67169-943a-48c4-8c2c-badcc1935788 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:01.232211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:01.232856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:01.233582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:01.233582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] PATH_INFO: `/v3/projects/b9e023c595b94d7385d3131a271f7343/users/1f80e91962d3474597cdb7cdb38f0283/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:01.248350 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e023c595b94d7385d3131a271f7343, user_id=1f80e91962d3474597cdb7cdb38f0283, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:01.251336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.305931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1163/2303] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:00:01 2022] PUT /identity/v3/projects/b9e023c595b94d7385d3131a271f7343/users/1f80e91962d3474597cdb7cdb38f0283/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:00:01.309981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:01.320635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff331-e075-486a-8a4a-2eb705c04d12 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:01.329318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:01.384254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:01.384914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:01.385199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:01.385476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:01.386182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:01.387806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145822c0-598d-483b-a658-00a25eb5ab0a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.398761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1141/2304] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:00:01.403146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:01.414704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b382bad-40aa-404e-87c2-c6b60c17300f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:01.419420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:01.420079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:01.420393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:01.420663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] PATH_INFO: `/v3/projects/b9e023c595b94d7385d3131a271f7343/users/1f80e91962d3474597cdb7cdb38f0283/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:01.423238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e023c595b94d7385d3131a271f7343, user_id=1f80e91962d3474597cdb7cdb38f0283, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:01.425904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:01.436514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1164/2305] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:00:01 2022] PUT /identity/v3/projects/b9e023c595b94d7385d3131a271f7343/users/1f80e91962d3474597cdb7cdb38f0283/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:00:07.163205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da663-c690-4751-a652-7256d6da54b4 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:07.164052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da663-c690-4751-a652-7256d6da54b4 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:07.164548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da663-c690-4751-a652-7256d6da54b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:07.194114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0a0da663-c690-4751-a652-7256d6da54b4 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:07.195365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0a0da663-c690-4751-a652-7256d6da54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:07.259566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1142/2306] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:07.274287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:07.276262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:07.373228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23796add-2b70-419d-a2d8-fde152f53737 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:07.381460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:07.382612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:07.383116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:07.383724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:07.393277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:07.395089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:07.406216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1165/2307] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:00:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:00:07.902131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d823-3bd1-4d26-b7fe-fde11113e1d1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:07.902469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d823-3bd1-4d26-b7fe-fde11113e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:07.902752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d823-3bd1-4d26-b7fe-fde11113e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:07.937507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-3054d823-3bd1-4d26-b7fe-fde11113e1d1 None None] MFA Rules not processed for user `1f80e91962d3474597cdb7cdb38f0283`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:07.939329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3054d823-3bd1-4d26-b7fe-fde11113e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:08.049047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1143/2308] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:08.063002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:08.064600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:08.080904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:08.179170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b0bd-b650-40f1-8621-1855a528ea99 service swift] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:08.187494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:08.188119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:08.188425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:08.188818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:08.264792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:08.266587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f2c60-4be9-4f63-bcb2-e36af4fe4008 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:08.277578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1166/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:11.259270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c641-4322-495f-ba9e-8b29be80473c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:11.259803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c641-4322-495f-ba9e-8b29be80473c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:11.259929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c641-4322-495f-ba9e-8b29be80473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:11.282234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1888c641-4322-495f-ba9e-8b29be80473c None None] MFA Rules not processed for user `3f53373c293d4766815306b616c8e241`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:11.286340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1888c641-4322-495f-ba9e-8b29be80473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:11.294171 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1144/2310] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:14.668710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:14.669229 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:14.669327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:14.690082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] MFA Rules not processed for user `6188ad0d16f1411a953693c9a29dceb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:14.691284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:14.747986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1167/2311] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:21.276163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=86 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:24.740931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=77 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:34.322099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3db1-184e-44b8-a3b2-9e7cd33b8a0e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:34.322714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3db1-184e-44b8-a3b2-9e7cd33b8a0e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:34.322821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a3db1-184e-44b8-a3b2-9e7cd33b8a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:34.342977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-8c7a3db1-184e-44b8-a3b2-9e7cd33b8a0e None None] MFA Rules not processed for user `613c1453a9794052a79a51c79d0ad8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:34.344188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8c7a3db1-184e-44b8-a3b2-9e7cd33b8a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:34.401563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1145/2312] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:42.377575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:42.379098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:42.436708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b7153-c2ec-49c9-ae1e-7b717ec4f66f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:42.440336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:42.440945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:42.441228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:42.441504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:42.450513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:42.451946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:42.461357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1168/2313] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:44.394593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=25 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:52.457174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=26 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:04.777530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:04.778043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:04.778149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:04.797580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] MFA Rules not processed for user `c8072b6bbaad4d4780ecf3ca96d098f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:04.798744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:04.857119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1146/2314] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:07.807199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:07.817969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97447-f2b3-4c1c-94e8-6cede280e491 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:07.821923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:07.823005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:07.823535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:07.823996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:07.826393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:07.840984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:07.842557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:07.855398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1169/2315] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:07.856941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:07.858861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:07.929901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a6cd-86e6-457d-aea2-402e6a712a56 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:07.933442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:07.934048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:07.934331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:07.934703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:07.936554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:07.950345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:07.951826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869bb59-05ba-4203-bbe9-fbaeb33d1906 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:07.967411 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1147/2316] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:14.433723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:14.445700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ece41-96d7-46b3-b21b-18a1ece099e8 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:14.451222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:14.451850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:14.452147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:14.452401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:14.454077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:14.465369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:14.466993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:14.479098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1170/2317] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:17.964086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=51 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:19.761734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.762388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.762388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.782258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] MFA Rules not processed for user `d04625404c4344bf9d1f11bc14ff69da`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:19.783652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:19.853901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1148/2318] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:20.290621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:20.300551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1148-55a1-4bfa-8e01-7c8bd3131d38 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:20.305938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:20.305938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:20.306170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:20.306358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:20.308121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:20.318193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:20.319645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:20.328276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1171/2319] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:20.730089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:20.731632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:20.808159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be2319-0361-4109-bc2a-ac7b4c3d1c8e None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:20.813478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:20.814341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:20.814661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:20.814941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:20.816960 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:20.830719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:20.833622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:20.845342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1149/2320] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:29.645927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:29.653974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:29.655609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6b96-086d-45e0-be99-4aa31bdcbf84 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:29.659889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:29.660552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:29.660835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:29.661115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:29.664374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:29.666911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a708e-398d-4996-b40b-ac5b2dd64675 service placement] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:29.670817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:29.671540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:29.671824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:29.672568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:29.675398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:29.676840 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:29.681366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:29.682821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:29.686735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1172/2321] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:29.691679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1150/2322] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:32.219915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.228918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec634b-fe82-4fc8-b8ec-0c4b26afb6b4 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.232443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.233028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.233318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.233657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.235520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.246838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.248239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.257675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1173/2323] 10.222.0.47 () {60 vars in 1396 bytes} [Tue Aug 30 15:01:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:36.250853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:36.260266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6598d-f3f3-4d31-bc20-22cd3e425fd2 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:36.263987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:36.264595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:36.264880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:36.265154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:36.266896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:36.328608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:36.330021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:36.339535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1151/2324] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:38.278071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:38.279662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:38.293041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=31 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:38.300708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2fb1-f341-4380-b83b-07d3e7c3b522 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:38.307909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:38.308725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:38.309087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:38.309436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:38.311572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:38.323475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:38.325185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:38.336111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1174/2325] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:39.767999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:39.782216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb16a32-10d1-426f-8d66-bd3ce1680759 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:39.787763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:39.788451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.789057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.789352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.791724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:39.806758 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:39.810897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:39.831608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1152/2326] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:40.220405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.222342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:40.251869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cb1c1-6fc7-4fee-9444-31718480cb05 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.267794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.268422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.274531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.275243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.277400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:40.293703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.295630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.309376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1175/2327] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:40.399588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.404413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:40.413400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:40.421460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f1f40-072f-495d-b6d4-9da7a563880e service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.426752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.427622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.428078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.428707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] PATH_INFO: `/v3/users/6188ad0d16f1411a953693c9a29dceb7` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.430209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6188ad0d16f1411a953693c9a29dceb7)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.432350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.585668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6188ad0d16f1411a953693c9a29dceb7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:40.587657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6188ad0d16f1411a953693c9a29dceb7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:40.654756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6188ad0d16f1411a953693c9a29dceb7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:40.669690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6188ad0d16f1411a953693c9a29dceb7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:40.677202 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-77998911-d51e-487d-b33f-ab0a6be52972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6188ad0d16f1411a953693c9a29dceb7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:40.683708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1153/2328] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:40 2022] DELETE /identity/v3/users/6188ad0d16f1411a953693c9a29dceb7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:40.947017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.958569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb2d4-b719-4061-b2cf-e20438824050 service placement] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.030616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.031264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.031550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.031828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] PATH_INFO: `/v3/projects/91df28a7c495424e8e3377f14ad6f5de` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.033002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df28a7c495424e8e3377f14ad6f5de)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.034963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.149096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df28a7c495424e8e3377f14ad6f5de', 'request_id': 'req-a795da13-3e81-4e45-92e5-59c449c450c8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.242830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df28a7c495424e8e3377f14ad6f5de', 'request_id': 'req-a795da13-3e81-4e45-92e5-59c449c450c8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.249902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df28a7c495424e8e3377f14ad6f5de', 'request_id': 'req-a795da13-3e81-4e45-92e5-59c449c450c8'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.260472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] The token cache is being invalidate because project 91df28a7c495424e8e3377f14ad6f5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:41.260767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.261418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a795da13-3e81-4e45-92e5-59c449c450c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.262947 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1176/2329] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:40 2022] DELETE /identity/v3/projects/91df28a7c495424e8e3377f14ad6f5de => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:41.268167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.268645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.268769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.290423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:41.291851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:41.353121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1154/2330] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:41.364946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.365239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.365516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.387689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:41.388826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:41.397264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1177/2331] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:41.402783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.412830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22fdf-0fe0-4934-ab97-c41a941dd066 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.419288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.419901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.420183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.420452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.421127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:41.421428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.423079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.435024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1155/2332] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:41.439438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.449089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe122-9ff8-4d21-82b1-cb6d2c2ad4c8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.454095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.454770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.455055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.455325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.455961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.457999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.585472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1178/2333] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:41.590181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.600376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6ec5-bb65-4892-893d-2d41e11df7c7 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.658247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.658881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.659162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.659431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.660051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.661972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.671547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:41.756172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1156/2334] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:41.765358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.777525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c1b80-0bf9-4d93-bb2c-c5dad23e2e36 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.782223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.783028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.783331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.783605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.784250 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.785861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.796632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1179/2335] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:41.800340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.810716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0331-2784-4d15-9bd7-44466a4b481d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.815609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.816228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.816511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.816788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.817437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.819057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be2627-0d8e-4cf9-b49d-b48057a49f6d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.831223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1157/2336] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:41.835361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.846353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1468-dd27-4ff7-936c-539c321d1b8c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.850905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.851546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.852154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.852154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] PATH_INFO: `/v3/projects/7ce392b91e864aae8f9b51e5d95623e7/users/0578ee36c3e941c1b1e37b03bd4f239b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.866230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce392b91e864aae8f9b51e5d95623e7, user_id=0578ee36c3e941c1b1e37b03bd4f239b, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.868943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.947149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1180/2337] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:41 2022] PUT /identity/v3/projects/7ce392b91e864aae8f9b51e5d95623e7/users/0578ee36c3e941c1b1e37b03bd4f239b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:41.958400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.958733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.959013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.989548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] MFA Rules not processed for user `0578ee36c3e941c1b1e37b03bd4f239b`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:41.990824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:42.059652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1158/2338] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:42.064246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.068658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:42.126327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100760bc-debb-4b31-9364-c08add813708 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.131196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.131802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.132083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.132360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.133615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.135554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.237131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1181/2339] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:42 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:42.241362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.252624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3e273-f336-4049-95eb-6187169b3b40 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.308018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.308661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.308889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.309162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.309789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.311722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.413627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1159/2340] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:42 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:42.417736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.428682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e732-2013-4e8b-8b33-cd44b8a34922 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.434319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.434956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.435237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.435510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.436156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.437815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.449279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1182/2341] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:42.453476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.464095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e89f-36c2-4a96-8ead-067ea7e942c0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.468742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.469398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.469679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.469958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] PATH_INFO: `/v3/projects/95aeb997b99c410687b009f5492862d6/users/9eb518e8bbd941a9965f4a1e43dd8fe6/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.486197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aeb997b99c410687b009f5492862d6, user_id=9eb518e8bbd941a9965f4a1e43dd8fe6, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.488883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.574733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1160/2342] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:42 2022] PUT /identity/v3/projects/95aeb997b99c410687b009f5492862d6/users/9eb518e8bbd941a9965f4a1e43dd8fe6/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:42.579103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.589784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956635ff-645e-4ca9-bdc8-fb2e6dd6a660 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.649342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.649983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.650263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.650569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.651217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.652906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575831-2bbb-44da-923c-f2da10f00e6a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.663474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1183/2343] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:42.668270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.678504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13ca1-b43e-41c4-aaea-7b2cafe900de admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.683984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.686127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.686127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.686127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] PATH_INFO: `/v3/projects/95aeb997b99c410687b009f5492862d6/users/9eb518e8bbd941a9965f4a1e43dd8fe6/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.687124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aeb997b99c410687b009f5492862d6, user_id=9eb518e8bbd941a9965f4a1e43dd8fe6, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.689766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.700162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1161/2344] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:42 2022] PUT /identity/v3/projects/95aeb997b99c410687b009f5492862d6/users/9eb518e8bbd941a9965f4a1e43dd8fe6/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:42.710681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.711006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.711308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.741113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] MFA Rules not processed for user `9eb518e8bbd941a9965f4a1e43dd8fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:42.742938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:42.809897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:42.815347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1184/2345] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:42.826920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.828738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:42.857312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:42.890635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd98c-1953-4ae4-8696-a588070ac78e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.894275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.894921 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.895206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.895478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.905454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.907126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.917836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1162/2346] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:43.142245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:43.143750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:43.156369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66635-0319-4e71-ae71-976b2f1d71d2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:43.160854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:43.161462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:43.161741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:43.162064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:43.223008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:43.224659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:43.235363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1185/2347] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:43.807151 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:43.810432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:43.948507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6954-6280-437c-a462-a6b08b6903c1 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:43.956204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:43.957220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:43.960016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:43.960334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:43.963420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:43.980142 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:43.982423 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42c8b9-d1e8-44f1-81f1-dd164cf61987 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:43.996285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1163/2348] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:52.207608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:52.271557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffdfd-2e13-4100-8744-8cbcb4947107 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:52.276880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:52.277504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.277817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.278095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] PATH_INFO: `/v3/users/0578ee36c3e941c1b1e37b03bd4f239b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.279262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0578ee36c3e941c1b1e37b03bd4f239b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:52.281212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:52.485403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0578ee36c3e941c1b1e37b03bd4f239b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.498161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0578ee36c3e941c1b1e37b03bd4f239b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.498962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0578ee36c3e941c1b1e37b03bd4f239b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.499594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0578ee36c3e941c1b1e37b03bd4f239b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.545831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0578ee36c3e941c1b1e37b03bd4f239b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.560925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1186/2349] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:52 2022] DELETE /identity/v3/users/0578ee36c3e941c1b1e37b03bd4f239b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:52.565485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.565960 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.566067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.589844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:52.591104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:52.658595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1164/2350] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:52.668735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:52.670152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:52.689360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:52.730284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5a01-5255-4264-bf6c-b329d8d8c2be admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:52.733885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:52.734525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.734808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.735079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.745368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:52.747180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1787229-c949-4482-a1ee-7ebf70514374 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:52.761929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1187/2351] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:53.159864 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.161538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.174762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1141f5f-8adb-4a69-9ebd-d84dac971dd1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.181522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.182096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.182503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.185884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] PATH_INFO: `/v3/projects/7ce392b91e864aae8f9b51e5d95623e7` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.185884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce392b91e864aae8f9b51e5d95623e7)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.186065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.284712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:53.287808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce392b91e864aae8f9b51e5d95623e7', 'request_id': 'req-3ab361af-bcce-4f64-a6fb-5891028bc158'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.357631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce392b91e864aae8f9b51e5d95623e7', 'request_id': 'req-3ab361af-bcce-4f64-a6fb-5891028bc158'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.367885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce392b91e864aae8f9b51e5d95623e7', 'request_id': 'req-3ab361af-bcce-4f64-a6fb-5891028bc158'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.380945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.381684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] The token cache is being invalidate because project 7ce392b91e864aae8f9b51e5d95623e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:53.381787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.381880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.382049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.382392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.383944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1165/2352] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:53 2022] DELETE /identity/v3/projects/7ce392b91e864aae8f9b51e5d95623e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:53.389586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.391217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.410061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:53.411344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.473032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab361af-bcce-4f64-a6fb-5891028bc158 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.474233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1188/2353] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:53.477977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.478716 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.480156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.480156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] PATH_INFO: `/v3/users/9eb518e8bbd941a9965f4a1e43dd8fe6` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.481036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb518e8bbd941a9965f4a1e43dd8fe6)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.483198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.689980 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.691465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.764973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabad509-8a6a-46ff-b8e3-5ab92dabff81 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.770084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.770846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.771132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.771412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.780663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.782252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.790636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1189/2354] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 15:01:53.805639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb518e8bbd941a9965f4a1e43dd8fe6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.806380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb518e8bbd941a9965f4a1e43dd8fe6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.905948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb518e8bbd941a9965f4a1e43dd8fe6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.920740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb518e8bbd941a9965f4a1e43dd8fe6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.927965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-fef75911-dbfd-41ce-8c28-f75f08cc161b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb518e8bbd941a9965f4a1e43dd8fe6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.934506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1166/2355] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:53 2022] DELETE /identity/v3/users/9eb518e8bbd941a9965f4a1e43dd8fe6 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:54.359930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.373623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d833-d2b7-474d-8b01-10686d63eb17 service swift] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.437304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:54.446644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.447859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.448147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.448418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] PATH_INFO: `/v3/projects/95aeb997b99c410687b009f5492862d6` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.449551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aeb997b99c410687b009f5492862d6)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.451730 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.576560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aeb997b99c410687b009f5492862d6', 'request_id': 'req-a87b2fef-cb35-4ef8-974f-5092acbc283b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:54.654438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aeb997b99c410687b009f5492862d6', 'request_id': 'req-a87b2fef-cb35-4ef8-974f-5092acbc283b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:54.661595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aeb997b99c410687b009f5492862d6', 'request_id': 'req-a87b2fef-cb35-4ef8-974f-5092acbc283b'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:54.674253 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] The token cache is being invalidate because project 95aeb997b99c410687b009f5492862d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:54.674922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:54.675951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a87b2fef-cb35-4ef8-974f-5092acbc283b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:54.677927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1190/2356] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:54 2022] DELETE /identity/v3/projects/95aeb997b99c410687b009f5492862d6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:54.683891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.684319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.684602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.708876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:54.710109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:54.767026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:54.779855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1167/2357] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:54.788708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.789207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.789719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.814216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:54.816248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:54.825073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1191/2358] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:54.829694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.840017 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca3ae-58ef-4fa1-aa8f-844abf17fac3 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.844628 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.845941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.845941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.845941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.846374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:54.846848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.848403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.860769 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1168/2359] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:01:54.865522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.876020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3597e7-49fb-4075-bf31-a80ed2f8f2d7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.881138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.882114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.882619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.882929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.883560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.886362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.004900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1192/2360] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:55.009392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.021243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ccbf5-76ed-452b-8f0a-53b9d1d4fea5 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.104815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.105473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.105752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.106308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.107016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.108936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.175681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1169/2361] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:55.179756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.194266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce96ee-9492-46db-a81f-ff5e4b56e33f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.203883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.204517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.205894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.206192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.206906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.209331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.222552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1193/2362] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:55.226619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.239000 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa9a6-b403-498d-ad4c-5b88f23cdad1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.244745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.245377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.245720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.246127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.246984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.248691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7158b-c4e0-4e9e-9153-a5866b0af97d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.265003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1170/2363] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:55.269171 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.280504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c458-a87b-4896-aad9-cfe8912beeed admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.286230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.287217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.287636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.287999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] PATH_INFO: `/v3/projects/a14c6dd9bea942daa9cf06ae5d82c0c8/users/9528f858616141899ca8baa4dd939cef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.314076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14c6dd9bea942daa9cf06ae5d82c0c8, user_id=9528f858616141899ca8baa4dd939cef, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.316879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.394142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1194/2364] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:55 2022] PUT /identity/v3/projects/a14c6dd9bea942daa9cf06ae5d82c0c8/users/9528f858616141899ca8baa4dd939cef/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:55.406875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.407168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.407442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.437907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] MFA Rules not processed for user `9528f858616141899ca8baa4dd939cef`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:55.439114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:55.515852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1171/2365] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:55.520191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.597202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4648-31b6-4ba2-baef-10011e216c49 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.602284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.602956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.603239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.603557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.604264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.606265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.887442 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1195/2366] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:55.891788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.903365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229067-9f63-49e1-bd52-11fdb5409958 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.965077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:55.987178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.988706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.990088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.990567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.991722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.993837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.091231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1172/2367] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:56.095096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.102671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:56.110308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf63c-f2fa-4771-8d9c-dda88a288285 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.116683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.117621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.118915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.118915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.118915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.121750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.134468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1196/2368] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:56.138891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.149624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671e2f-c5ac-4393-9ea0-ed9079685d62 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.154869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.155580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.155871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.156152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] PATH_INFO: `/v3/projects/9841c4bffa92401db862b609b377f237/users/11dc4e8243f44f90bd9bdd6345068bc5/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.172218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841c4bffa92401db862b609b377f237, user_id=11dc4e8243f44f90bd9bdd6345068bc5, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.174998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.255699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1173/2369] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:56 2022] PUT /identity/v3/projects/9841c4bffa92401db862b609b377f237/users/11dc4e8243f44f90bd9bdd6345068bc5/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:56.260223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.270861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bd83-9a6f-4b15-b725-21750b243320 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.348427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.349516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.349744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.350020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.350768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.352548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621c3a1-baaa-4aac-8a78-c23b5c2b4934 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.370553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1197/2370] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:56.371006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.381999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad0b72-7413-453e-a5a5-42b71e47661c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.387658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.388615 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.388948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.389230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] PATH_INFO: `/v3/projects/9841c4bffa92401db862b609b377f237/users/11dc4e8243f44f90bd9bdd6345068bc5/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.391662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841c4bffa92401db862b609b377f237, user_id=11dc4e8243f44f90bd9bdd6345068bc5, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.394428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.410407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1174/2371] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:56 2022] PUT /identity/v3/projects/9841c4bffa92401db862b609b377f237/users/11dc4e8243f44f90bd9bdd6345068bc5/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:56.421614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.428558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.428558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.454679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] MFA Rules not processed for user `11dc4e8243f44f90bd9bdd6345068bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:56.456141 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:56.533952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1198/2372] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:56.549119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.550995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:56.620285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707b511-e96a-4692-b25f-cbc6bf6c1299 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.623948 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.624623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.624897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.625167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.637128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.642565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d82a-b8ef-487b-b122-61fa676b235b service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.649475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1175/2373] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:57.637356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:57.726191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4597f-f242-43b5-91d8-177294314f6d None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:57.732449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:57.733580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:57.734063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:57.734578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] PATH_INFO: `/v3/users/9528f858616141899ca8baa4dd939cef` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:57.736168 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9528f858616141899ca8baa4dd939cef)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:57.738543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:57.764231 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:57.972132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9528f858616141899ca8baa4dd939cef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:57.997267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9528f858616141899ca8baa4dd939cef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:57.997981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9528f858616141899ca8baa4dd939cef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:57.998733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9528f858616141899ca8baa4dd939cef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:58.060837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9528f858616141899ca8baa4dd939cef'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:58.074352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1199/2374] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:57 2022] DELETE /identity/v3/users/9528f858616141899ca8baa4dd939cef => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:58.079194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:58.079658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:58.079762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:58.102182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:58.103525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:58.230024 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1176/2375] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:58.246573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:58.249599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:58.336722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388349e-f895-426b-a036-c970d79675e5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:58.343614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:58.344739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:58.345077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:58.345354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:58.379819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:58.381295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:58.399508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1200/2376] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:59.244229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:59.246228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:59.276613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b28c9-34f3-4bfd-94dd-93db7c6c4803 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:59.276613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:59.276613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:59.276613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:59.277189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] PATH_INFO: `/v3/projects/a14c6dd9bea942daa9cf06ae5d82c0c8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:59.277189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14c6dd9bea942daa9cf06ae5d82c0c8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:59.277189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:59.446910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:59.473122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14c6dd9bea942daa9cf06ae5d82c0c8', 'request_id': 'req-8a751310-57e2-4b78-a449-ce23610fd448'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.569733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14c6dd9bea942daa9cf06ae5d82c0c8', 'request_id': 'req-8a751310-57e2-4b78-a449-ce23610fd448'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.578583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14c6dd9bea942daa9cf06ae5d82c0c8', 'request_id': 'req-8a751310-57e2-4b78-a449-ce23610fd448'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.594267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] The token cache is being invalidate because project a14c6dd9bea942daa9cf06ae5d82c0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:59.594699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.595663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.598577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1177/2377] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:59 2022] DELETE /identity/v3/projects/a14c6dd9bea942daa9cf06ae5d82c0c8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:59.602745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:59.613322 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c590f-d5bd-47eb-8239-3dcdab17e0d4 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:59.688473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:59.689590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:59.690080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:59.690620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] PATH_INFO: `/v3/users/11dc4e8243f44f90bd9bdd6345068bc5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:59.692517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dc4e8243f44f90bd9bdd6345068bc5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:59.694946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:59.878576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:59.893553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dc4e8243f44f90bd9bdd6345068bc5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.907821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dc4e8243f44f90bd9bdd6345068bc5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.908625 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dc4e8243f44f90bd9bdd6345068bc5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.909258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dc4e8243f44f90bd9bdd6345068bc5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:59.976091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-365aba4d-e00f-4e94-9419-754ab8bf7755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dc4e8243f44f90bd9bdd6345068bc5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.005877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1201/2378] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:59 2022] DELETE /identity/v3/users/11dc4e8243f44f90bd9bdd6345068bc5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:00.558366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:00.559999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:00.576297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751310-57e2-4b78-a449-ce23610fd448 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:00.694483 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:00.695192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:00.695677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:00.696122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] PATH_INFO: `/v3/projects/9841c4bffa92401db862b609b377f237` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:00.697489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9841c4bffa92401db862b609b377f237)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:00.701246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:00.831969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9841c4bffa92401db862b609b377f237', 'request_id': 'req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.907148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9841c4bffa92401db862b609b377f237', 'request_id': 'req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.914832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9841c4bffa92401db862b609b377f237', 'request_id': 'req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.928200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] The token cache is being invalidate because project 9841c4bffa92401db862b609b377f237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:00.928503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.929452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b049da24-24ce-43d0-b5b3-4ad6cde9ff3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:00.931010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1178/2379] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:00 2022] DELETE /identity/v3/projects/9841c4bffa92401db862b609b377f237 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:00.936757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:00.937334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:00.937334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:00.961167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:00.962547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:01.032595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1202/2380] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:01.040852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.041162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.041802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.063771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:01.065291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:01.086932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1179/2381] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:01.093770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.110047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4cd2e-169d-4c01-8eef-72281f406706 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.115413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.116026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.116305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.116610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.117337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:01.117643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.119360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.142302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1203/2382] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:01.142569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.158762 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d612a2-2c55-4849-97d1-0ef2e03d2ce1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.165583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.167357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.167651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.167977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.168640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.170722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.264246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1180/2383] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:01 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:01.268091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.279678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800862d-63dc-42c3-ab07-6b8ff9aef972 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.339308 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.340084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.340369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.340641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.341296 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.343301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.461050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.469160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1204/2384] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:01 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:01.473867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece733-06c3-4b35-a9f6-d960c3eafa9b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.479702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.480924 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.481437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.481866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.482719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.484534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.520176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.523753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1181/2385] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:01.533453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fe68-d1b9-4f62-b31b-0ac5bf8133a8 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.538694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.539821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.540192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.540583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.541331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.543803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf7e39-fdd9-4356-afd9-5e61a134c99b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.559779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1205/2386] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:01.565970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.574951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdffeab-f212-43b2-b741-a434abfbc01e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.580546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.581331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.581835 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.582223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] PATH_INFO: `/v3/projects/9ed365124e60490ea65292c08ec91e33/users/bd235e0e53c14a898c25749673a5383d/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.601640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed365124e60490ea65292c08ec91e33, user_id=bd235e0e53c14a898c25749673a5383d, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.606160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.609649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:01.690684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1182/2387] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:01 2022] PUT /identity/v3/projects/9ed365124e60490ea65292c08ec91e33/users/bd235e0e53c14a898c25749673a5383d/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:01.703169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.703495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.703763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.739008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] MFA Rules not processed for user `bd235e0e53c14a898c25749673a5383d`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:01.740780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:01.757345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:01.836819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1206/2388] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:01.841493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.917540 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017905c-f1ff-4195-95ce-bc490eae0b62 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.923011 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.923633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.924149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.924294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.924818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.927086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.019078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1183/2389] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:01 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:02.022932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.044968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dfdc6-6b13-483c-9921-827451227de5 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.119786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.120413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.120690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.120967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.121609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.123643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.255717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1207/2390] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:02 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:02.259999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.271851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0b4-d0a4-47be-b2aa-0e226b3a871a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.277180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.277812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.278092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.278365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.279074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.280675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.292905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1184/2391] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:02.299339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.308236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584de6b-00e2-4214-902a-d6a8efc96edb admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.313161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.313825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.314112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.314389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] PATH_INFO: `/v3/projects/7b9a025a6cbe4859810414cb96617af0/users/0ee5070f62c242d2b85686c44da025c4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.331959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9a025a6cbe4859810414cb96617af0, user_id=0ee5070f62c242d2b85686c44da025c4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.334871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.422874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1208/2392] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:02 2022] PUT /identity/v3/projects/7b9a025a6cbe4859810414cb96617af0/users/0ee5070f62c242d2b85686c44da025c4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:02.427026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.438063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f182c-30bf-471c-bc53-1df12b0061df admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.511510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.511510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.511510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.511510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.512139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.512139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a5d5b-ce09-47f6-bfa6-a2c33f9a0687 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.532060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.532502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1185/2393] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:02.547252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6690-adc3-4586-bf7d-4bb48545963c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.550300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.551115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.551396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.551672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] PATH_INFO: `/v3/projects/7b9a025a6cbe4859810414cb96617af0/users/0ee5070f62c242d2b85686c44da025c4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.553805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9a025a6cbe4859810414cb96617af0, user_id=0ee5070f62c242d2b85686c44da025c4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.556836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.569907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1209/2394] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:02 2022] PUT /identity/v3/projects/7b9a025a6cbe4859810414cb96617af0/users/0ee5070f62c242d2b85686c44da025c4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:02.581259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.581726 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.581844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.612073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] MFA Rules not processed for user `0ee5070f62c242d2b85686c44da025c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:02.613607 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:02.670134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:02.690566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1186/2395] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:02.701996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:02.703758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:02.779088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44640-05e8-4a48-99af-bf7e3b8131d4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:02.782666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:02.783274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:02.783556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:02.783829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:02.793535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:02.794998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:02.804594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1210/2396] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:03.657633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:03.659262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:03.735594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8288-e93f-4be5-8d70-2f1984957f9a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:03.740951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:03.741771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:03.742047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:03.742324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] PATH_INFO: `/v3/users/0cb7b32e84864011814b0381eda6ce2e` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:03.743505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb7b32e84864011814b0381eda6ce2e)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:03.746154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:03.948815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb7b32e84864011814b0381eda6ce2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:03.949464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb7b32e84864011814b0381eda6ce2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.027783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb7b32e84864011814b0381eda6ce2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.046503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb7b32e84864011814b0381eda6ce2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.053896 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:04.063409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb7b32e84864011814b0381eda6ce2e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.065473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be307e-ed4b-4e25-a331-f4706f903512 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:04.067743 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1187/2397] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:03 2022] DELETE /identity/v3/users/0cb7b32e84864011814b0381eda6ce2e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:04.070389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:04.075287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:04.075611 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:04.076004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] PATH_INFO: `/v3/users/bd235e0e53c14a898c25749673a5383d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:04.077387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd235e0e53c14a898c25749673a5383d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:04.079657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:04.081451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:04.275237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd235e0e53c14a898c25749673a5383d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.287800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd235e0e53c14a898c25749673a5383d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.288658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd235e0e53c14a898c25749673a5383d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.289492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd235e0e53c14a898c25749673a5383d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.332434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:04.334039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:04.347620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4cf13668-3b69-4158-98d1-ab118c6c9f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd235e0e53c14a898c25749673a5383d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.364664 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1211/2398] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:04 2022] DELETE /identity/v3/users/bd235e0e53c14a898c25749673a5383d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:04.369056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:04.369413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:04.369612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:04.390207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:04.391909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:04.416258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f57f-3942-4b88-a5d4-a98c98ba9ab1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:04.429557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:04.458083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1212/2399] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:04.469667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:04.472053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:04.488285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:04.488943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:04.489225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:04.489598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] PATH_INFO: `/v3/projects/5edb0c096a9246069f236d97d0f3e9da` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:04.490834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edb0c096a9246069f236d97d0f3e9da)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:04.492932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:04.536119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb945a5-5196-4128-824e-748a824984d3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:04.540006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:04.540554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:04.540864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:04.541136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:04.551333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:04.552762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:04.564492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1213/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:04.624248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edb0c096a9246069f236d97d0f3e9da', 'request_id': 'req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.689928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edb0c096a9246069f236d97d0f3e9da', 'request_id': 'req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.697258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edb0c096a9246069f236d97d0f3e9da', 'request_id': 'req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.709664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] The token cache is being invalidate because project 5edb0c096a9246069f236d97d0f3e9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:04.709957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.710662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:04.712205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1188/2401] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:04 2022] DELETE /identity/v3/projects/5edb0c096a9246069f236d97d0f3e9da => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:04.716370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:04.717999 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:04.735203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e449-98bb-4ca0-9788-060de2b3f0e9 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:04.771326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:04.838673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:04.839773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:04.840282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:04.840785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] PATH_INFO: `/v3/users/1dd5627006334a03b439267698f8fa89` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:04.842772 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd5627006334a03b439267698f8fa89)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:04.846695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:05.028852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:05.030340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:05.044073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0936d6-7144-44ac-ad49-52f5a2ffb35a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:05.053160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:05.060193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:05.060584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:05.060873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] PATH_INFO: `/v3/projects/9ed365124e60490ea65292c08ec91e33` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:05.062166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed365124e60490ea65292c08ec91e33)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:05.064150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:05.066942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd5627006334a03b439267698f8fa89'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.079578 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd5627006334a03b439267698f8fa89'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.080346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd5627006334a03b439267698f8fa89'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.080954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd5627006334a03b439267698f8fa89'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.153305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd5627006334a03b439267698f8fa89'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.169427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1214/2402] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:04 2022] DELETE /identity/v3/users/1dd5627006334a03b439267698f8fa89 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:05.175317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed365124e60490ea65292c08ec91e33', 'request_id': 'req-993c2d2e-7408-4af7-b217-6126c47acd08'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.250369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed365124e60490ea65292c08ec91e33', 'request_id': 'req-993c2d2e-7408-4af7-b217-6126c47acd08'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.261838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed365124e60490ea65292c08ec91e33', 'request_id': 'req-993c2d2e-7408-4af7-b217-6126c47acd08'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.273041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] The token cache is being invalidate because project 9ed365124e60490ea65292c08ec91e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:05.273189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.273869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.275821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1189/2403] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:05 2022] DELETE /identity/v3/projects/9ed365124e60490ea65292c08ec91e33 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:05.280136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:05.281624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:05.311775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:05.313286 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:05.350723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:05.374582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf6e5-8fcb-404c-be9a-41b2476c6e7a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:05.379707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:05.380164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c2d2e-7408-4af7-b217-6126c47acd08 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:05.380376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:05.380630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:05.380923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] PATH_INFO: `/v3/users/0ee5070f62c242d2b85686c44da025c4` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:05.382030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee5070f62c242d2b85686c44da025c4)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:05.384277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:05.433060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:05.433691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:05.433969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:05.434240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:05.436058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:05.450818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:05.452292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:05.464152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1190/2404] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:05.465433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:05.466776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:05.478460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417dcd7-8246-457d-b639-81e30ff42da1 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:05.484207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:05.492968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:05.492968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:05.492968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] PATH_INFO: `/v3/projects/56111c836ae94d70a6b00cc91243f125` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:05.492968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56111c836ae94d70a6b00cc91243f125)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:05.492968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:05.561158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:05.564034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee5070f62c242d2b85686c44da025c4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.578506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee5070f62c242d2b85686c44da025c4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.581111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee5070f62c242d2b85686c44da025c4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.581111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee5070f62c242d2b85686c44da025c4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.605889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56111c836ae94d70a6b00cc91243f125', 'request_id': 'req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.673223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee5070f62c242d2b85686c44da025c4'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.686256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1215/2405] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:05 2022] DELETE /identity/v3/users/0ee5070f62c242d2b85686c44da025c4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:05.719039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56111c836ae94d70a6b00cc91243f125', 'request_id': 'req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.729081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56111c836ae94d70a6b00cc91243f125', 'request_id': 'req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.746631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] The token cache is being invalidate because project 56111c836ae94d70a6b00cc91243f125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:05.747065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.748042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7b49f4e9-8fd2-4865-bf35-7dfa2ba588c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:05.749978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1191/2406] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:05 2022] DELETE /identity/v3/projects/56111c836ae94d70a6b00cc91243f125 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:06.183420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.184989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.262103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479e-d481-44af-a52b-920811d4c36c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.266854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.267501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.267784 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.268060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] PATH_INFO: `/v3/projects/7b9a025a6cbe4859810414cb96617af0` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.269230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9a025a6cbe4859810414cb96617af0)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.271179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.370513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9a025a6cbe4859810414cb96617af0', 'request_id': 'req-bdea7093-ec2b-4736-ae1b-f09100e9202a'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.432904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9a025a6cbe4859810414cb96617af0', 'request_id': 'req-bdea7093-ec2b-4736-ae1b-f09100e9202a'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.439936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9a025a6cbe4859810414cb96617af0', 'request_id': 'req-bdea7093-ec2b-4736-ae1b-f09100e9202a'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.458426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] The token cache is being invalidate because project 7b9a025a6cbe4859810414cb96617af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:06.458426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.458426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-bdea7093-ec2b-4736-ae1b-f09100e9202a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.463518 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1216/2407] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:06 2022] DELETE /identity/v3/projects/7b9a025a6cbe4859810414cb96617af0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:06.467516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.467969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.468406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.493089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:06.494626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.577712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1192/2408] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:06.586954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.587516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.587953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.611279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:06.612516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.626426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1217/2409] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:06.627637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.639950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7ea8-9c2a-4536-9488-f10f3a2f6d99 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.645422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.645990 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.646378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.647199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.649712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:06.650268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.652909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.660966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:06.668071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1193/2410] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:06.675129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.685387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e5aff-d0df-4953-b99d-de192eaff341 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.690337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.690986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.691337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.691621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.692292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.694277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.792835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1218/2411] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:06 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:06.794141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.805561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ce74-a49f-414c-b0a7-5c873fb3611d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.875232 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.876180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.876521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.876744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.877405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.879662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.970972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1194/2412] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:06 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:06.975355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.987216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b1804-8220-4b43-a4e7-ec107d8d85be admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.992342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.993001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.993285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.993562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.994219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.996524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.007778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1219/2413] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:07.012060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.022904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8a2d-102d-4d60-9414-66166992c4c2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.030649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.031269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.031548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.031815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.032498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:07.034117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2b3d9-cfdc-4363-985a-28517f68c90e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.047073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1195/2414] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:07.051154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.065079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f80af-a208-44ff-901c-ca0489aec05a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.070066 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.070806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.071089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.071362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] PATH_INFO: `/v3/projects/7f2f6cdaf37243c9bb63e781fa922cf0/users/3706863149944ea3963751e11d35d8f9/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.080210 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:07.087553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2f6cdaf37243c9bb63e781fa922cf0, user_id=3706863149944ea3963751e11d35d8f9, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:07.092871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.159167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1220/2415] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:07 2022] PUT /identity/v3/projects/7f2f6cdaf37243c9bb63e781fa922cf0/users/3706863149944ea3963751e11d35d8f9/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:07.171182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a319a-a383-49bf-b563-4d11090d561d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.171536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a319a-a383-49bf-b563-4d11090d561d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.171844 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a319a-a383-49bf-b563-4d11090d561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.206814 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-757a319a-a383-49bf-b563-4d11090d561d None None] MFA Rules not processed for user `3706863149944ea3963751e11d35d8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:07.208547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-757a319a-a383-49bf-b563-4d11090d561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:07.302497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1196/2416] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:07.312539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.314924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:07.378413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776488a8-4e82-4414-b161-7a9c04e5dac7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.382659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.383295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.383560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.383832 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.394944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:07.396429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d5ff2-96dc-4760-ad8c-b9c7dfbb0fd4 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.408226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1221/2417] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:07.429581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a319a-a383-49bf-b563-4d11090d561d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.520009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a319a-a383-49bf-b563-4d11090d561d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.525523 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.526759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.527144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.527487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] PATH_INFO: `/v3/users/3706863149944ea3963751e11d35d8f9` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.528754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3706863149944ea3963751e11d35d8f9)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:07.530733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.536803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:07.730956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3706863149944ea3963751e11d35d8f9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.731770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3706863149944ea3963751e11d35d8f9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.781244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3706863149944ea3963751e11d35d8f9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.796892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3706863149944ea3963751e11d35d8f9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.804514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3706863149944ea3963751e11d35d8f9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.812043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1197/2418] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:07 2022] DELETE /identity/v3/users/3706863149944ea3963751e11d35d8f9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:07.817361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.817658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.817940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.837774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:07.839156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:07.911541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1222/2419] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:07.924225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.925657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:07.991600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f92a9b-b12b-4fcb-b60e-b738e5227350 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.995476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.996095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.996379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.996655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.006463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.008098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a05e-d081-4616-81bc-51cca413bfc5 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.018342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1198/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:08.487139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.489876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.505294 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5948f-cfee-412a-8605-b1608a3fc15a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:08.510490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:08.516764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.516764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.516764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] PATH_INFO: `/v3/projects/7f2f6cdaf37243c9bb63e781fa922cf0` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.518206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2f6cdaf37243c9bb63e781fa922cf0)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.520120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.664558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2f6cdaf37243c9bb63e781fa922cf0', 'request_id': 'req-2246e268-8024-4989-9066-a2ca5ac5f2bb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.763245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2f6cdaf37243c9bb63e781fa922cf0', 'request_id': 'req-2246e268-8024-4989-9066-a2ca5ac5f2bb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.763245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2f6cdaf37243c9bb63e781fa922cf0', 'request_id': 'req-2246e268-8024-4989-9066-a2ca5ac5f2bb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.768148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] The token cache is being invalidate because project 7f2f6cdaf37243c9bb63e781fa922cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:08.768451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.769628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2246e268-8024-4989-9066-a2ca5ac5f2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.776367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1223/2421] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:08 2022] DELETE /identity/v3/projects/7f2f6cdaf37243c9bb63e781fa922cf0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:08.778317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.778630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.778912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.805305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:08.806596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.896082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1199/2422] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:08.904780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.904989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.905374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.933906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:08.935373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.943818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1224/2423] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:08.948111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.962244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aed6b6-652f-4812-b87c-a081b8051efa None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:08.967982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:08.968725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.969086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.969426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.970087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:08.970395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.972029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.985405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1200/2424] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:08.989974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.000298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62798-2232-4b11-9432-1ba6e9cc5d13 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.005130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.005745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.006025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.006338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.006992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.009174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.014789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:09.113238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1225/2425] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:08 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:09.118490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.130370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448bc69-cc8f-412b-8b6f-9865646d404a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.143621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:09.201614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.202694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.203200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.203702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.204834 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.207297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.308174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1201/2426] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:09 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:09.312374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.322767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00606d0-21a5-4548-862f-bf522e35e81c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.328097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.328863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.329014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.329307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.329923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.332376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.344568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1226/2427] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:09.345487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.347705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:09.349013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.361360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e081f49-bab3-48a2-864f-de2c67b0f3b5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.364487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651241e-35a8-44a0-82d9-061da22f628c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.369754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.370647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.371162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.371662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] PATH_INFO: `/v3/users/613c1453a9794052a79a51c79d0ad8f1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.372842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.372989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=613c1453a9794052a79a51c79d0ad8f1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.373084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.373361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.373662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.374312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.374961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.376040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.391072 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1227/2428] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:09.392169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.402652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36251-9b58-4e3c-846d-2ee378786193 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.407863 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.408557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.408848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.409124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] PATH_INFO: `/v3/projects/02b21bcc914549b8ad6fb2a5ab1055c8/users/940f9b9be6b146f798c18f504eac50fb/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.426387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b21bcc914549b8ad6fb2a5ab1055c8, user_id=940f9b9be6b146f798c18f504eac50fb, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.429059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a499e5-57ce-450f-9462-51bf612a0024 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.531240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1228/2429] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:09 2022] PUT /identity/v3/projects/02b21bcc914549b8ad6fb2a5ab1055c8/users/940f9b9be6b146f798c18f504eac50fb/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:09.542557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.542854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.543137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.573096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] MFA Rules not processed for user `940f9b9be6b146f798c18f504eac50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:09.575043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:09.590760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613c1453a9794052a79a51c79d0ad8f1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.591475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613c1453a9794052a79a51c79d0ad8f1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.638741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613c1453a9794052a79a51c79d0ad8f1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.643113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1229/2430] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:09.652869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613c1453a9794052a79a51c79d0ad8f1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.653829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.655473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:09.660745 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613c1453a9794052a79a51c79d0ad8f1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.667326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1202/2431] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:09 2022] DELETE /identity/v3/users/613c1453a9794052a79a51c79d0ad8f1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:09.720358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864972d2-5248-429b-bd22-d76c5053a0b3 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.764594 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:09.772852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.773486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.773754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.774028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.839908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.841382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74f940-74c1-495f-b91d-11f425b315d0 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.850436 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1230/2432] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:09.927608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.929300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.003161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dda3d-5dc5-4248-8ba6-9c1f73ddbb6e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.008143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.008773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.009052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.009328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] PATH_INFO: `/v3/projects/01901764fc0b4afcafebec78c6f2b91a` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.010438 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01901764fc0b4afcafebec78c6f2b91a)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.012685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.043295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:10.127515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01901764fc0b4afcafebec78c6f2b91a', 'request_id': 'req-f90373b4-8bd5-4ea8-848d-eec4e95861b6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.227642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01901764fc0b4afcafebec78c6f2b91a', 'request_id': 'req-f90373b4-8bd5-4ea8-848d-eec4e95861b6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.235516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01901764fc0b4afcafebec78c6f2b91a', 'request_id': 'req-f90373b4-8bd5-4ea8-848d-eec4e95861b6'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.246766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] The token cache is being invalidate because project 01901764fc0b4afcafebec78c6f2b91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:10.247108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.247724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f90373b4-8bd5-4ea8-848d-eec4e95861b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.249451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1203/2433] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:09 2022] DELETE /identity/v3/projects/01901764fc0b4afcafebec78c6f2b91a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:10.254236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.254550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.254869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.274616 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.275856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.336357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1231/2434] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:10.345469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.345759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.346089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.367026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.368254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.378987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1204/2435] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:10.383358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.395259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec5217-576e-4d35-a637-ec9ad3dafd8e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.401287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.402413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.403613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.403893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.404567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:10.404910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.406537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.427850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1232/2436] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:10.428611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.438937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9299ab-4750-4ec7-9596-8adafcec16be None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.444120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.447384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.447384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.447384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.447384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.448076 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.550816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1205/2437] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:10.555084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.566235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb42ac-4018-4938-b99e-7d7a49071c5f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.631922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.632459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.632997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.633266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.633952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.635885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.770671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1233/2438] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:10.774933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.785775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405d194-ef2d-4b46-92f1-90cb94db10e3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.790390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.791028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.791434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.791649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.792880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.794675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.805190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1206/2439] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:10.816792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.828005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7796-eb8a-4c04-936f-9ebb03e4f898 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.832954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.833566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.833846 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.834123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.834795 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.836422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584a60-bcfb-4292-bf33-2e4478b45ac7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.848675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1234/2440] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:10.853302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.864125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebe5d3-b2fe-483d-8d0a-fbaffbb2012d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.868699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.869356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.869641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.869920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] PATH_INFO: `/v3/projects/7147b8fa2d7e41228d6c40072782fda7/users/8dcb817fdae44da9971388b4ee2a6d09/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.885780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7147b8fa2d7e41228d6c40072782fda7, user_id=8dcb817fdae44da9971388b4ee2a6d09, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.888614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.948509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1207/2441] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:10 2022] PUT /identity/v3/projects/7147b8fa2d7e41228d6c40072782fda7/users/8dcb817fdae44da9971388b4ee2a6d09/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:10.959418 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.959704 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.959976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.969208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:10.990391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] MFA Rules not processed for user `8dcb817fdae44da9971388b4ee2a6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.991734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:11.059434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1235/2442] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:11.064042 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.137851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329c65c-56bf-4e87-8c36-a2a885c9bbc6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.142911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.143280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.143567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.143843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.144863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.146617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.240894 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1208/2443] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.245247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.256548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a45d-3b55-4670-93a1-0c75947015eb None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.316204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.316816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.317104 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.317408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.318078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.320008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.434957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1236/2444] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.439756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.452231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2257772-f792-4ba7-9518-9158ea6fe426 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.457153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.457799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.458084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.458360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.459061 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.460763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.473003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1209/2445] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:11.478472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.489495 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bca5b-e2bf-4133-a019-4d796d455c76 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.494430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.495150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.496038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.496507 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] PATH_INFO: `/v3/projects/748f6029b96740409604bdc0fe413631/users/322a73e705cf41938c26d1584df69746/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.513012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=748f6029b96740409604bdc0fe413631, user_id=322a73e705cf41938c26d1584df69746, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.515770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.612290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1237/2446] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:11 2022] PUT /identity/v3/projects/748f6029b96740409604bdc0fe413631/users/322a73e705cf41938c26d1584df69746/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:11.616338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.627474 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655447a-0068-4f93-a35a-4ed17167cbae admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.640625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:11.692006 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.692377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.692656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.692927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.693577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.695254 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01efcb-0095-432b-8445-84b8d94ce4e0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.706147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1210/2447] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:11.711631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.723456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc82e1-2fe2-4e0c-9a88-8cf8236fc2ca admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.728384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.729054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.729337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.729631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] PATH_INFO: `/v3/projects/748f6029b96740409604bdc0fe413631/users/322a73e705cf41938c26d1584df69746/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.732221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748f6029b96740409604bdc0fe413631, user_id=322a73e705cf41938c26d1584df69746, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.734940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.745859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1238/2448] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:11 2022] PUT /identity/v3/projects/748f6029b96740409604bdc0fe413631/users/322a73e705cf41938c26d1584df69746/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:11.759353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.759896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.760395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.794522 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] MFA Rules not processed for user `322a73e705cf41938c26d1584df69746`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:11.795810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:11.876115 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1211/2449] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:11.887136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.888843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:11.946334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:11.951641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f32fa-359e-4641-8116-da66a84edc48 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.965633 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.966167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.966503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.966822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.985335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.986883 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bcee1-5d65-4618-88e9-3f73b185022f service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.998006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1239/2450] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:12.159141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:12.225717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d85e5-8df8-4bab-98da-8b132858aede None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:12.230307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:12.230994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:12.231273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:12.231546 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] PATH_INFO: `/v3/users/8dcb817fdae44da9971388b4ee2a6d09` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:12.232984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcb817fdae44da9971388b4ee2a6d09)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:12.235058 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:12.414134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:12.419508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcb817fdae44da9971388b4ee2a6d09'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:12.420176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcb817fdae44da9971388b4ee2a6d09'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:12.467504 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcb817fdae44da9971388b4ee2a6d09'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:12.480978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcb817fdae44da9971388b4ee2a6d09'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:12.488644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcb817fdae44da9971388b4ee2a6d09'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:12.494765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1212/2451] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:12 2022] DELETE /identity/v3/users/8dcb817fdae44da9971388b4ee2a6d09 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:12.499833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:12.500228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:12.500580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:12.520685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:12.521897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:12.584420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1240/2452] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:12.595547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:12.597005 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:12.657755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759b96a-9aca-461b-897a-1c87a2d8086b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:12.661428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:12.662049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:12.662315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:12.662618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:12.672207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:12.673632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:12.684122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1213/2453] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:13.115726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:13.117264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:13.130864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c2c0-d2fc-45db-a237-847a4c0fc57c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:13.136906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:13.137994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:13.138494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:13.138952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] PATH_INFO: `/v3/projects/7147b8fa2d7e41228d6c40072782fda7` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:13.140791 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7147b8fa2d7e41228d6c40072782fda7)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:13.143409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:13.274191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7147b8fa2d7e41228d6c40072782fda7', 'request_id': 'req-08457211-bd40-47e6-a40e-ba611653aa8c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.331706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7147b8fa2d7e41228d6c40072782fda7', 'request_id': 'req-08457211-bd40-47e6-a40e-ba611653aa8c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.343574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7147b8fa2d7e41228d6c40072782fda7', 'request_id': 'req-08457211-bd40-47e6-a40e-ba611653aa8c'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.365553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] The token cache is being invalidate because project 7147b8fa2d7e41228d6c40072782fda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:13.365553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.366565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.369415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1241/2454] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:13 2022] DELETE /identity/v3/projects/7147b8fa2d7e41228d6c40072782fda7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:13.373728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:13.384386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a548a-d3fb-4690-a318-8290ed24270c service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:13.446197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:13.446997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:13.447277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:13.447557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] PATH_INFO: `/v3/users/322a73e705cf41938c26d1584df69746` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:13.448831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] RBAC: Authorizing `identity:delete_user(user_id=322a73e705cf41938c26d1584df69746)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:13.450946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:13.640333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322a73e705cf41938c26d1584df69746'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.641136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322a73e705cf41938c26d1584df69746'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.696384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322a73e705cf41938c26d1584df69746'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.705339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:13.710840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322a73e705cf41938c26d1584df69746'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.719148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9a4d3d2e-0012-4291-92f6-30cbf2f8052b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322a73e705cf41938c26d1584df69746'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:13.725387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1214/2455] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:13 2022] DELETE /identity/v3/users/322a73e705cf41938c26d1584df69746 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:14.169239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:14.171631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:14.184893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457211-bd40-47e6-a40e-ba611653aa8c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:14.262691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:14.263342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.263658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.263956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] PATH_INFO: `/v3/projects/748f6029b96740409604bdc0fe413631` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.265135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748f6029b96740409604bdc0fe413631)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:14.267243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:14.285240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:14.417213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748f6029b96740409604bdc0fe413631', 'request_id': 'req-76571171-23a3-4181-8f48-f61068a44c05'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:14.486085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748f6029b96740409604bdc0fe413631', 'request_id': 'req-76571171-23a3-4181-8f48-f61068a44c05'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:14.494002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748f6029b96740409604bdc0fe413631', 'request_id': 'req-76571171-23a3-4181-8f48-f61068a44c05'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:14.517467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] The token cache is being invalidate because project 748f6029b96740409604bdc0fe413631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:14.518076 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:14.518857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-76571171-23a3-4181-8f48-f61068a44c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:14.524163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1242/2456] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:14 2022] DELETE /identity/v3/projects/748f6029b96740409604bdc0fe413631 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:14.525809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.526290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.526374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.550410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:14.551602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:14.634499 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1215/2457] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:14.643891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.644618 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.645001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.673747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:14.674933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:14.683995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1243/2458] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:14.692094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:14.703612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c450-fa88-4b87-9b67-a84aecc602e9 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:14.708826 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:14.709478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.709761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.710039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.710740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:14.711049 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:14.712951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:14.729304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1216/2459] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:14.735342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:14.746589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254b08-0bac-4536-a4aa-53f189c66293 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:14.751622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:14.752273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.752555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.752829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.753501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:14.756019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:14.872563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1244/2460] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:14 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:14.874987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:14.887527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499df37-f279-426e-88b5-a2667a8ede2c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:14.956223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:14.956845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.957126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.957398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.958153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:14.960054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.058480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1217/2461] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:14 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:15.068208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.079366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2607650-a00d-4406-8a5b-1568028b8b11 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.084161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.084765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.085045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.085316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.090284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.090284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.099189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1245/2462] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:15.103808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.118159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1764c-58e2-471e-857c-277ada38cf0e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.122967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.123668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.123975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.124223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.125057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.126481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7417074-3c97-432a-8092-0fee0b4138d0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.138132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1218/2463] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:15.142735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.153945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f724c-bf2b-4152-800e-eb8af46d7ec4 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.158673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.159324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.159604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.159875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] PATH_INFO: `/v3/projects/4f3684087e7748388cbfc02114041094/users/7572dc17dc294c038ae73a265a390f32/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.175926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3684087e7748388cbfc02114041094, user_id=7572dc17dc294c038ae73a265a390f32, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.178671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.279761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1246/2464] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:15 2022] PUT /identity/v3/projects/4f3684087e7748388cbfc02114041094/users/7572dc17dc294c038ae73a265a390f32/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:15.281297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.281593 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.281875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.309732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] MFA Rules not processed for user `7572dc17dc294c038ae73a265a390f32`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:15.310981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:15.345541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:15.376239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1219/2465] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:15.381622 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.455329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ec4a-2ba6-438c-8748-5a71b8d99ee3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.461162 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.461833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.462119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.462513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.463098 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.466127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.588650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1247/2466] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:15 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:15.590532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.601372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd011-f29c-4185-96cd-2c05bae040ae None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.673536 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.674156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.674534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.674734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.675542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.677492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.840660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1220/2467] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:15 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:15.844726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.855984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebc0a9-f023-4ed2-9aeb-edb5873db4f0 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.860597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.861198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.861662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.861937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.862617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.864217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.876117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1248/2468] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:15.883598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.894140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a74b0c-010a-45cd-b15b-1d48fd6deabf admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.898847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:15.899517 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:15.899803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:15.900085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] PATH_INFO: `/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1/users/4bae2cbed35742ffa149aecb923c5e75/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:15.916285 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcaf6c0d4ea4c2a9923177a8f7c62b1, user_id=4bae2cbed35742ffa149aecb923c5e75, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:15.919943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:15.965333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1221/2469] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:15 2022] PUT /identity/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1/users/4bae2cbed35742ffa149aecb923c5e75/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:15.969589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:15.980532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715a33-bf22-47ca-af7f-1ba9fe352ebf admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:15.989837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:16.046743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:16.046743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.046981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.047265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.047914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:16.049522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1898bc-950f-4d74-9e77-b626c465ebc6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:16.067837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1249/2470] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:16.068677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:16.079284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c189e-f3f1-4770-b40a-73931a2dcc86 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:16.084336 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:16.084938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.085228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.085501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] PATH_INFO: `/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1/users/4bae2cbed35742ffa149aecb923c5e75/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.087539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcaf6c0d4ea4c2a9923177a8f7c62b1, user_id=4bae2cbed35742ffa149aecb923c5e75, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:16.090279 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:16.103386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1222/2471] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:16 2022] PUT /identity/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1/users/4bae2cbed35742ffa149aecb923c5e75/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:16.115010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.115302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.115589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.157133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] MFA Rules not processed for user `4bae2cbed35742ffa149aecb923c5e75`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:16.157801 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:16.256588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1250/2472] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:16.286626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:16.288661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:16.355657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adde5b-480d-4628-9179-df9a77863bd0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:16.359137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:16.359748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.360026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.360297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.370332 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:16.372197 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:16.383513 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1223/2473] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:16.707631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:16.729759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60090e-466d-4f30-9981-4e3b637c9bff None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:16.735261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:16.735907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.736233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.736520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.852166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:16.853925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb788b-d978-41f5-b30e-8b9ae531484d service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:16.867130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1251/2474] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:20.595444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.639995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:20.673118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a415f-124e-4884-98bf-be52250f721a service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.678075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.679160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.679577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.680484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] PATH_INFO: `/v3/users/7572dc17dc294c038ae73a265a390f32` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.681697 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7572dc17dc294c038ae73a265a390f32)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.684683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.864264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7572dc17dc294c038ae73a265a390f32'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.866436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7572dc17dc294c038ae73a265a390f32'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.931549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7572dc17dc294c038ae73a265a390f32'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.956432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7572dc17dc294c038ae73a265a390f32'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.969528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7572dc17dc294c038ae73a265a390f32'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.977175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1224/2475] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:20 2022] DELETE /identity/v3/users/7572dc17dc294c038ae73a265a390f32 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:20.988523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.994484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.994484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.015833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:21.017349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:21.056247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:21.095642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1252/2476] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:21.102521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.103928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:21.172928 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe23207-c4bc-40cf-958b-5c4afaa79f04 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.179862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.180770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.181186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.181613 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.196256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.197943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.210972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1225/2477] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:21.642600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.644094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:21.656800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c8494-6c98-4af3-a7fa-e3d86ddd76e4 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.662195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.663149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.663590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.663981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] PATH_INFO: `/v3/projects/4f3684087e7748388cbfc02114041094` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.665353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3684087e7748388cbfc02114041094)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.686567 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.810336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3684087e7748388cbfc02114041094', 'request_id': 'req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:21.885912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3684087e7748388cbfc02114041094', 'request_id': 'req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:21.893557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3684087e7748388cbfc02114041094', 'request_id': 'req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:21.904770 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] The token cache is being invalidate because project 4f3684087e7748388cbfc02114041094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:21.905061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:21.905712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:21.907301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1253/2478] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:21 2022] DELETE /identity/v3/projects/4f3684087e7748388cbfc02114041094 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:21.911384 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.922133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60166c0-47de-4a56-9f3e-59baebbef18e service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.977760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:21.988734 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.989476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.989757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.990027 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] PATH_INFO: `/v3/users/4bae2cbed35742ffa149aecb923c5e75` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.991241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bae2cbed35742ffa149aecb923c5e75)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.993186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:22.129216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bae2cbed35742ffa149aecb923c5e75'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.130068 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bae2cbed35742ffa149aecb923c5e75'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.211641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bae2cbed35742ffa149aecb923c5e75'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.225272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bae2cbed35742ffa149aecb923c5e75'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.233331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5efb562-8158-4b08-b898-4884da5f68cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bae2cbed35742ffa149aecb923c5e75'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.239670 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1226/2479] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:21 2022] DELETE /identity/v3/users/4bae2cbed35742ffa149aecb923c5e75 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:22.278671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:22.280371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:22.297359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f09b6d-2539-4af9-bf8b-92bf5ecfb0fd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:22.364724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:22.366631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:22.366631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:22.366631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] PATH_INFO: `/v3/users/940f9b9be6b146f798c18f504eac50fb` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:22.367187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=940f9b9be6b146f798c18f504eac50fb)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:22.369419 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:22.538287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940f9b9be6b146f798c18f504eac50fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.555275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:22.565047 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940f9b9be6b146f798c18f504eac50fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.567290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940f9b9be6b146f798c18f504eac50fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.568695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940f9b9be6b146f798c18f504eac50fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.628998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940f9b9be6b146f798c18f504eac50fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:22.647746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1254/2480] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:22 2022] DELETE /identity/v3/users/940f9b9be6b146f798c18f504eac50fb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:22.653114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:22.653477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:22.653841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:22.685709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:22.686996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:22.761223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1227/2481] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:22.763358 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:22.765499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:22.773949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:22.776475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:22.779668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76083c4-1118-4368-ab2c-65d5c5b05f3b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:22.785411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:22.786043 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:22.786610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:22.786776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] PATH_INFO: `/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:22.788018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcaf6c0d4ea4c2a9923177a8f7c62b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:22.792496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:22.853552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619db7e-96d1-4887-9658-781ae5863000 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:22.860144 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:22.861169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:22.861298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:22.861674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:22.874754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:22.874754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2226c-82b5-4ab1-9a9d-aef8ad1266a8 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:22.890972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1228/2482] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:22.949742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcaf6c0d4ea4c2a9923177a8f7c62b1', 'request_id': 'req-5766eed2-b0f4-4233-a10c-7041080ad871'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.063347 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcaf6c0d4ea4c2a9923177a8f7c62b1', 'request_id': 'req-5766eed2-b0f4-4233-a10c-7041080ad871'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.071568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcaf6c0d4ea4c2a9923177a8f7c62b1', 'request_id': 'req-5766eed2-b0f4-4233-a10c-7041080ad871'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.084828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] The token cache is being invalidate because project bbcaf6c0d4ea4c2a9923177a8f7c62b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:23.085001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.085555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-5766eed2-b0f4-4233-a10c-7041080ad871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.087116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1255/2483] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:22 2022] DELETE /identity/v3/projects/bbcaf6c0d4ea4c2a9923177a8f7c62b1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:23.093976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.094514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.094869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.117751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:23.119067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.132592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:23.195998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1229/2484] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:23.207543 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.207924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.208221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.234416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:23.236343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.251626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1256/2485] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:23.253013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.266110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a6bc-01a0-48f9-a88b-f28084331eb2 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.272493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.273183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.273470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.273746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.274476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:23.274800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.276466 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.291543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1230/2486] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:23.296241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.306146 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ad937-5f7b-49d4-80e4-89bc358f36e1 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.312523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.313359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.313643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.313918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.314597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.316580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.488875 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1257/2487] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/projects => generated 409 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:23.492508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.503998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacbc89-a5aa-472d-a71c-97863402cc4c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.518926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.520981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.585514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.586143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.586427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.586800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.587452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.589410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.600835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f0d7-7e09-488b-ba13-00071e8af1df admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.606342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.607038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.607298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.607568 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] PATH_INFO: `/v3/projects/02b21bcc914549b8ad6fb2a5ab1055c8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.608728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b21bcc914549b8ad6fb2a5ab1055c8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.610729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.709333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1231/2488] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/users => generated 305 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:23.714015 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.725137 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539872-2121-417a-816a-e5b83faa5e6c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.730403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.731273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.747133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.747133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.747133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.747133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.747532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:23.750759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1232/2489] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:23.751696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b21bcc914549b8ad6fb2a5ab1055c8', 'request_id': 'req-c632b4e0-1df7-4c08-88ff-1161e5bec278'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.751831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.762624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072dbd-6bd7-4f0a-8994-87a262303d0e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.825333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.825934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.826280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.826732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.827398 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.829095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.839972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1233/2490] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:23.844372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.853891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b21bcc914549b8ad6fb2a5ab1055c8', 'request_id': 'req-c632b4e0-1df7-4c08-88ff-1161e5bec278'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.856484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d35d-959e-4e14-a4a2-a8764561acdd admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.861318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.861852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b21bcc914549b8ad6fb2a5ab1055c8', 'request_id': 'req-c632b4e0-1df7-4c08-88ff-1161e5bec278'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.862023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.862288 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.862668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] PATH_INFO: `/v3/projects/84e7b5d1abd44dc0a7ed80ed8bd89105/users/1ef98ce1efe34cabb4db8f1a3792b088/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.875760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] The token cache is being invalidate because project 02b21bcc914549b8ad6fb2a5ab1055c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:23.876143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.877842 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c632b4e0-1df7-4c08-88ff-1161e5bec278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.879719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1258/2491] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:23 2022] DELETE /identity/v3/projects/02b21bcc914549b8ad6fb2a5ab1055c8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:23.893170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e7b5d1abd44dc0a7ed80ed8bd89105, user_id=1ef98ce1efe34cabb4db8f1a3792b088, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.893170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.893170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:23.967489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1234/2492] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:23 2022] PUT /identity/v3/projects/84e7b5d1abd44dc0a7ed80ed8bd89105/users/1ef98ce1efe34cabb4db8f1a3792b088/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:23.979435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.979724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.980002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.019148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] MFA Rules not processed for user `1ef98ce1efe34cabb4db8f1a3792b088`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:24.020544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:24.131998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1259/2493] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:24.137465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.139591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:24.218379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaa2a3-1ac9-4480-a666-2cad811fbf9a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.223713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.224334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.224639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.224911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.225568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.230038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.305050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1235/2494] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:24 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:24.309786 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.326916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7a33-f6aa-475d-838a-f461d5954a14 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.388983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.389519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.389803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.390081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.390776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.392710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.469749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1260/2495] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:24 2022] POST /identity/v3/users => generated 310 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:24.474777 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.486114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138fafb-7843-461f-b60a-e305438f4196 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.490776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.491391 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.491668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.491941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.492606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.494161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.509494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1236/2496] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:24.515215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.526617 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fd943-d06a-4259-89b6-17974dc312d8 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.532057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.532743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.533030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.533306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] PATH_INFO: `/v3/projects/9a0dc0192e204976a7d4792e69325871/users/01f0b4acb5ac479695a4296d99c2ed99/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.550613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0dc0192e204976a7d4792e69325871, user_id=01f0b4acb5ac479695a4296d99c2ed99, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.553277 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.613099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1261/2497] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:24 2022] PUT /identity/v3/projects/9a0dc0192e204976a7d4792e69325871/users/01f0b4acb5ac479695a4296d99c2ed99/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:24.618492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.629349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4477-7cf0-44d9-86d4-5f08fda310c5 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.688323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.688853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.689133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.689406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.690263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.691914 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd48102-f7dd-4a5e-9147-22055c4d43ef admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.703988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1237/2498] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:24.708155 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.719771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565de2-fa29-4f74-b005-5d0a9a698700 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.724399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.725068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.725375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.725651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] PATH_INFO: `/v3/projects/9a0dc0192e204976a7d4792e69325871/users/01f0b4acb5ac479695a4296d99c2ed99/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.727690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0dc0192e204976a7d4792e69325871, user_id=01f0b4acb5ac479695a4296d99c2ed99, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.730547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.744284 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1262/2499] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:24 2022] PUT /identity/v3/projects/9a0dc0192e204976a7d4792e69325871/users/01f0b4acb5ac479695a4296d99c2ed99/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:24.756509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.756827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.757107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.785838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] MFA Rules not processed for user `01f0b4acb5ac479695a4296d99c2ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:24.787087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:24.841748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:24.861316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1238/2500] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:24.873169 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.875749 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:24.891866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:24.954293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94448f-cf43-4ef5-ae36-4eb03d38d731 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.957882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.958612 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.958939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.959212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.969261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.970737 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21aa9-5d23-42ca-94f7-c854ffbb4892 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.981202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1263/2501] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:24 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:25.395273 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:25.407846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9adf2-9e43-4b7a-afa6-e7f0d3fb27a0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:25.411709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:25.412325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.412608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.412876 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.487163 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:25.488783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:25.499101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1239/2502] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:25 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:28.749497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:28.750102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:28.750102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:28.772099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:28.773228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:28.857827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1264/2503] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:28.874783 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:28.878623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:28.956867 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac401ce4-205f-4497-93fb-c80f98e3b1ac service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:28.963933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:28.964406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:28.964700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:28.964989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:28.975221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:28.976927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:28.987149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1240/2504] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:02:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:02:31.458052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:31.459484 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:31.555016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa97d7-54d9-42d7-af61-885aed544be0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:31.564185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:31.564962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:31.565556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:31.566099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:31.568474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:31.585747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:31.590953 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd202-ab65-45f1-ab0f-0a4af545077b service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:31.606223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1265/2505] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:33.089651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:33.203328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a3acf-0066-4d0a-99d4-09facccd6241 service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:33.208965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:33.209740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:33.210401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:33.210401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] PATH_INFO: `/v3/users/1ef98ce1efe34cabb4db8f1a3792b088` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:33.216570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef98ce1efe34cabb4db8f1a3792b088)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:33.216570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:33.270739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:33.489861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef98ce1efe34cabb4db8f1a3792b088'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:33.490749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef98ce1efe34cabb4db8f1a3792b088'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:33.567014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef98ce1efe34cabb4db8f1a3792b088'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:33.584661 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef98ce1efe34cabb4db8f1a3792b088'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:33.595141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef98ce1efe34cabb4db8f1a3792b088'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:33.604984 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1241/2506] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:33 2022] DELETE /identity/v3/users/1ef98ce1efe34cabb4db8f1a3792b088 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:33.610307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:33.610984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:33.610984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:33.638823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:33.640235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:33.690025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:33.730619 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1266/2507] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:33.736957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:33.739329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:33.764255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:33.766074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:33.820050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893fc95-f2b0-4664-a47c-fba411a57353 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:33.824303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:33.825129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:33.834291 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:33.836183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:33.842176 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8fe4e-bbec-445d-a693-2c6226238353 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:33.846554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:33.847412 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:33.847764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:33.848130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:33.848755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:33.850155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:33.850381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:33.866879 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:33.867107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1242/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:33.867989 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:33.882690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1267/2509] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:34.833172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:34.836331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:34.863451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac66e0-eaf8-45ae-87ac-4fa11ec86a9b service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:34.879402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:34.880098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:34.880385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:34.880683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] PATH_INFO: `/v3/projects/84e7b5d1abd44dc0a7ed80ed8bd89105` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:34.881887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e7b5d1abd44dc0a7ed80ed8bd89105)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:34.883898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:35.021228 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e7b5d1abd44dc0a7ed80ed8bd89105', 'request_id': 'req-a0eb128e-2174-43cc-ad2e-92bf80535367'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.099206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e7b5d1abd44dc0a7ed80ed8bd89105', 'request_id': 'req-a0eb128e-2174-43cc-ad2e-92bf80535367'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.112525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e7b5d1abd44dc0a7ed80ed8bd89105', 'request_id': 'req-a0eb128e-2174-43cc-ad2e-92bf80535367'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.128310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] The token cache is being invalidate because project 84e7b5d1abd44dc0a7ed80ed8bd89105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:35.128624 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.129685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.133809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1243/2510] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:34 2022] DELETE /identity/v3/projects/84e7b5d1abd44dc0a7ed80ed8bd89105 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:35.138707 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:35.149323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebd6b-f645-42d7-ba79-71df95553388 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:35.235728 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:35.236951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:35.237389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:35.237670 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] PATH_INFO: `/v3/users/01f0b4acb5ac479695a4296d99c2ed99` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:35.240131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f0b4acb5ac479695a4296d99c2ed99)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:35.243142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:35.503485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f0b4acb5ac479695a4296d99c2ed99'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.527516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f0b4acb5ac479695a4296d99c2ed99'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.531114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f0b4acb5ac479695a4296d99c2ed99'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.531827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f0b4acb5ac479695a4296d99c2ed99'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.664904 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-001f404a-6fcb-4a0d-a396-009e2a1c400f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f0b4acb5ac479695a4296d99c2ed99'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:35.693380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:35.699016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1268/2511] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:35 2022] DELETE /identity/v3/users/01f0b4acb5ac479695a4296d99c2ed99 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:36.629988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:36.631731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:36.665334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb128e-2174-43cc-ad2e-92bf80535367 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:36.693610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:36.750237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:36.751135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:36.751509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:36.751890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] PATH_INFO: `/v3/projects/9a0dc0192e204976a7d4792e69325871` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:36.753248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0dc0192e204976a7d4792e69325871)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:36.755322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:36.922554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0dc0192e204976a7d4792e69325871', 'request_id': 'req-27f19623-6791-4733-8423-49dc9d32ce5a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.984530 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0dc0192e204976a7d4792e69325871', 'request_id': 'req-27f19623-6791-4733-8423-49dc9d32ce5a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.992469 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0dc0192e204976a7d4792e69325871', 'request_id': 'req-27f19623-6791-4733-8423-49dc9d32ce5a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.031875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] The token cache is being invalidate because project 9a0dc0192e204976a7d4792e69325871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:37.032353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.034132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-27f19623-6791-4733-8423-49dc9d32ce5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.036140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1244/2512] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:36 2022] DELETE /identity/v3/projects/9a0dc0192e204976a7d4792e69325871 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:37.042498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.043744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.044454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.070396 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:37.070779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:37.180356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1269/2513] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:37.180945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.181236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.181537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.233264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:37.234543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:37.245194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1245/2514] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:37.249943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.261541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd0a42-5583-4edd-a67e-11d660a06983 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.269805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.270420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.270752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.271036 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.271718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:37.272021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.273689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.291438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1270/2515] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:37.296781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.312344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b060-a9ee-4414-8db1-fa909e72268f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.322552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.323375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.323665 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.324093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.326008 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.329010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.427885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1246/2516] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:37.445137 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.465580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf100-6dd5-4d7b-a131-9b4413bdd9ee admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.578603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.579361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.579717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.580073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.580839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.582826 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.706777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1271/2517] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:37 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:37.707037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.721147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ba37f-9cae-4b96-ad57-0fbb2823ff07 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.739906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.740587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.740902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.741188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.741901 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.744616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.767366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.767871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1247/2518] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:37.784721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660781-d71d-42bf-b593-8811b20d1655 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.792346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.793634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.793998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.794286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.795180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.798561 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa0645-3ffe-44d4-a4ef-a629f8f22408 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.819652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1272/2519] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:37.822170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.834785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334475-cdab-431a-9c05-d998cdade56d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.845577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.846564 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.846979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.847319 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] PATH_INFO: `/v3/projects/a9ddc4aacb704547ab4c6bd6ae3c5270/users/f959e495db9248fd9fcdd0df740dc453/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.869581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ddc4aacb704547ab4c6bd6ae3c5270, user_id=f959e495db9248fd9fcdd0df740dc453, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.872601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.992348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1248/2520] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:37 2022] PUT /identity/v3/projects/a9ddc4aacb704547ab4c6bd6ae3c5270/users/f959e495db9248fd9fcdd0df740dc453/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:38.004559 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.005050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.005362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.116234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] MFA Rules not processed for user `f959e495db9248fd9fcdd0df740dc453`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:38.118522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.239047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.242236 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.277575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:38.317001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1273/2521] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:38.318202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.397098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:38.431531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a0b4-8d9e-4724-9827-0e07c43202f6 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.445614 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.446464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.446833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.447184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.447943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.450348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.488500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15697-6137-44bd-be4c-ad577ae6c329 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.509618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.511078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.511431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.511713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.519296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.570824 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1274/2522] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:38.577895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.674858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.676500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.704133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947b667-05e0-4e19-bee4-c7b431bedb49 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.709175 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1249/2523] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:38.710778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.712093 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.712387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.712811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.713516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.715830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.803800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1275/2524] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:38.807925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.824299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362a6c-5796-46eb-a356-9a31f2d206d2 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.839127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.840669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.842221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.842794 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.844180 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.846287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.861132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1250/2525] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:38.863794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.884111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b4c2a-263a-4034-8c9d-98fa31d592af admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.902852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.903868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.904398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.904909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] PATH_INFO: `/v3/projects/782a4436bc4349768ba828706957a15b/users/e3f1316f6b8546bfa10d49b3ea7b3339/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.930094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=782a4436bc4349768ba828706957a15b, user_id=e3f1316f6b8546bfa10d49b3ea7b3339, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.932825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.010089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1276/2526] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:38 2022] PUT /identity/v3/projects/782a4436bc4349768ba828706957a15b/users/e3f1316f6b8546bfa10d49b3ea7b3339/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:39.015212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.027292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab986e7-1923-4fd8-a19c-243e3e05c8b9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.134813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.136599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.136922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.137416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.138082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.140436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c271c2-2bac-4a26-a5e0-91ae89fc5c98 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.178012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1251/2527] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:39.183096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.200145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043aa8f-6074-4a95-bbf3-bea35a5fee8e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.205596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.206318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.206656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.206945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] PATH_INFO: `/v3/projects/782a4436bc4349768ba828706957a15b/users/e3f1316f6b8546bfa10d49b3ea7b3339/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.208886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782a4436bc4349768ba828706957a15b, user_id=e3f1316f6b8546bfa10d49b3ea7b3339, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.211695 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.234486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1277/2528] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:39 2022] PUT /identity/v3/projects/782a4436bc4349768ba828706957a15b/users/e3f1316f6b8546bfa10d49b3ea7b3339/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:39.239819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.240846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.240846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.272729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] MFA Rules not processed for user `e3f1316f6b8546bfa10d49b3ea7b3339`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:39.273967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.371477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:39.388106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1252/2529] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:39.406128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.406128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.466326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:39.472865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.474618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.506993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e68b1-b9bb-4396-9588-e9dadea58b87 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.511967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.512888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.513241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.513605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.533649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.535423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.549952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1278/2530] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:39.575197 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.578581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.585672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b67c3-ef35-472f-98d8-67776b1a56be None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.593746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.594512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.594879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.595891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.607322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.629797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.634843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.657262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1253/2531] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:39.688305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b315-ce9c-4c24-9005-5e68336fb42e service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.694644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.697709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.698000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.698285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] PATH_INFO: `/v3/users/d04625404c4344bf9d1f11bc14ff69da` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.699628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04625404c4344bf9d1f11bc14ff69da)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.702202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.752917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.764154 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff94b-64aa-471f-9d6a-9f11ea5bfbc5 service placement] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.768380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.769114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.769464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.769811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.872267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.874931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.892677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1254/2532] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:39.894394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04625404c4344bf9d1f11bc14ff69da'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:39.912771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04625404c4344bf9d1f11bc14ff69da'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:39.913877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04625404c4344bf9d1f11bc14ff69da'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:39.914881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04625404c4344bf9d1f11bc14ff69da'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:39.981445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04625404c4344bf9d1f11bc14ff69da'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:40.013251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1279/2533] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:39 2022] DELETE /identity/v3/users/d04625404c4344bf9d1f11bc14ff69da => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:40.627579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:40.643448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e5064-f77f-467c-877c-1d3d596540a4 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:40.718999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:40.718999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.718999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.718999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] PATH_INFO: `/v3/projects/978e53cb67c54053911e4333ccd65f66` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.719575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978e53cb67c54053911e4333ccd65f66)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:40.719575 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.723907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:40.725987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:40.742984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7aee7-8cb4-46f1-a128-cd952482dc33 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:40.748059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:40.748861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.749213 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.749558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] PATH_INFO: `/v3/users/f959e495db9248fd9fcdd0df740dc453` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.751725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f959e495db9248fd9fcdd0df740dc453)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:40.753836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.883099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:41.029762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f959e495db9248fd9fcdd0df740dc453'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.033575 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:41.034868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978e53cb67c54053911e4333ccd65f66', 'request_id': 'req-b53c636a-d756-4afe-85dd-e6842cff42a1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.043494 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f959e495db9248fd9fcdd0df740dc453'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.044236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f959e495db9248fd9fcdd0df740dc453'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.044864 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f959e495db9248fd9fcdd0df740dc453'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.104354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978e53cb67c54053911e4333ccd65f66', 'request_id': 'req-b53c636a-d756-4afe-85dd-e6842cff42a1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.113356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978e53cb67c54053911e4333ccd65f66', 'request_id': 'req-b53c636a-d756-4afe-85dd-e6842cff42a1'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.129092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] The token cache is being invalidate because project 978e53cb67c54053911e4333ccd65f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:41.129432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.130212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b53c636a-d756-4afe-85dd-e6842cff42a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.132084 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1255/2534] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:40 2022] DELETE /identity/v3/projects/978e53cb67c54053911e4333ccd65f66 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:41.137606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc414-aa63-4f11-894b-f4ac859f25d8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.137981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc414-aa63-4f11-894b-f4ac859f25d8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.138323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc414-aa63-4f11-894b-f4ac859f25d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.169020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-04bbc414-aa63-4f11-894b-f4ac859f25d8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:41.170500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-04bbc414-aa63-4f11-894b-f4ac859f25d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:41.179223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-28d1ae79-14e0-496d-9964-ba9eec6a6f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f959e495db9248fd9fcdd0df740dc453'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:41.216127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1280/2535] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:40 2022] DELETE /identity/v3/users/f959e495db9248fd9fcdd0df740dc453 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:41.232286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.232600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.234427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.271830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1256/2536] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:41.273464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.273843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.274247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.287377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:41.288620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:41.299342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:41.300724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:41.386698 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1257/2537] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:41.391590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:41.413064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1281/2538] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:41.413277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d0fc-412d-48dd-b0d5-3b866764e035 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:41.420986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:41.425474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:41.427795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:41.429143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.430207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.430592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.431583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:41.431971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:41.434584 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:41.465505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1258/2539] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:41.466722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:41.493071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed05d-6936-4935-b6ef-e04ab069783e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:41.503568 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:41.505102 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.505507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.505890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.506688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:41.510422 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:41.525102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110d30f-c891-4cf7-80ae-a96cea7d9efe None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:41.528848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:41.529462 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.535533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.535533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.541201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:41.543111 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:41.556874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1282/2540] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:41.690653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1259/2541] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:41.694891 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:41.706356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16928-0bd2-4c36-b120-c995193ba2fc service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:41.779607 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:41.780843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.780843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.781262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.782810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:41.784835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:41.950822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:41.961867 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1283/2542] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:41 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:41.966339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:41.978190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbf8fd-718d-400e-8d8f-f0e23b615c45 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:41.983114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:41.983725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:41.984009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:41.984283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:41.985837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:41.987495 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:41.999041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1260/2543] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:42.004165 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.019026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcdac-e847-4505-8a0e-f3b96b9d0500 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.021389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.023519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:42.038579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.039304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.039654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.039935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.040592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.042212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.044781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f791b6-5a96-405a-9a05-6a4ba93c9dfe admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.050327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.051096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.051281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.052824 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] PATH_INFO: `/v3/projects/a9ddc4aacb704547ab4c6bd6ae3c5270` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.053996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ddc4aacb704547ab4c6bd6ae3c5270)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.055410 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1284/2544] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:42.056032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.059534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.064108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:42.074134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49987c-edc3-4351-93c5-47e2dbf8e9e2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.078963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.079681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.079962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.080237 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] PATH_INFO: `/v3/projects/8d4dd79dbf134c8aa46b564c8d6f184d/users/7fc17ba09079475ab44bd462c016291b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.098769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4dd79dbf134c8aa46b564c8d6f184d, user_id=7fc17ba09079475ab44bd462c016291b, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.101460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9994d8-f7c3-415f-86fe-b3bf42b72dd5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.167970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1285/2545] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:42 2022] PUT /identity/v3/projects/8d4dd79dbf134c8aa46b564c8d6f184d/users/7fc17ba09079475ab44bd462c016291b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:42.178763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ddc4aacb704547ab4c6bd6ae3c5270', 'request_id': 'req-346d4d48-14c4-4c36-b0e4-ecd918df5b70'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.178995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.179102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.179345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.208374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] MFA Rules not processed for user `7fc17ba09079475ab44bd462c016291b`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:42.209515 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:42.241514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ddc4aacb704547ab4c6bd6ae3c5270', 'request_id': 'req-346d4d48-14c4-4c36-b0e4-ecd918df5b70'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.250097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ddc4aacb704547ab4c6bd6ae3c5270', 'request_id': 'req-346d4d48-14c4-4c36-b0e4-ecd918df5b70'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.263460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] The token cache is being invalidate because project a9ddc4aacb704547ab4c6bd6ae3c5270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:42.263764 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.264487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.270811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1261/2546] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:42 2022] DELETE /identity/v3/projects/a9ddc4aacb704547ab4c6bd6ae3c5270 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:42.271906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.273255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:42.285113 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1286/2547] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:42.301736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.303214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:42.346801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4d48-14c4-4c36-b0e4-ecd918df5b70 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.352417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.353394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.353685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.353956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] PATH_INFO: `/v3/users/e3f1316f6b8546bfa10d49b3ea7b3339` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.355829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f1316f6b8546bfa10d49b3ea7b3339)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.357807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.384061 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894bb48-ede8-4ea3-a547-81f28339ea03 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.394390 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.395051 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.395339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.396279 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.404267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.405991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.415964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1287/2548] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:42.530164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f1316f6b8546bfa10d49b3ea7b3339'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.530892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f1316f6b8546bfa10d49b3ea7b3339'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.589641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f1316f6b8546bfa10d49b3ea7b3339'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.604895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f1316f6b8546bfa10d49b3ea7b3339'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.612537 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-17fb115d-66be-459a-80a5-6b43a33d2d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f1316f6b8546bfa10d49b3ea7b3339'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:42.618751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1262/2549] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:42 2022] DELETE /identity/v3/users/e3f1316f6b8546bfa10d49b3ea7b3339 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:43.116493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:43.136174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd51d1f-a5ad-456e-aff3-32dffba66b1a service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:43.201673 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:43.243926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:43.244582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.244871 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.245145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] PATH_INFO: `/v3/projects/782a4436bc4349768ba828706957a15b` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.246632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782a4436bc4349768ba828706957a15b)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:43.248589 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:43.358974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782a4436bc4349768ba828706957a15b', 'request_id': 'req-458d212b-c56c-4982-84e0-adec95d01587'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:43.419038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782a4436bc4349768ba828706957a15b', 'request_id': 'req-458d212b-c56c-4982-84e0-adec95d01587'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:43.426485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782a4436bc4349768ba828706957a15b', 'request_id': 'req-458d212b-c56c-4982-84e0-adec95d01587'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:43.439615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] The token cache is being invalidate because project 782a4436bc4349768ba828706957a15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:43.440017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:43.441086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-458d212b-c56c-4982-84e0-adec95d01587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:43.442946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1288/2550] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:43 2022] DELETE /identity/v3/projects/782a4436bc4349768ba828706957a15b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:43.448358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.450616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.450616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.474699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:43.475988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:43.481625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:43.671775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1263/2551] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:43.681355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.681639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.681960 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.702726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:43.704158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:43.712232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1289/2552] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:43.718861 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:43.729672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03fb36-5b2c-47ea-a193-1404b6046ef1 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:43.734310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:43.735608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.735828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.736221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.736871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:43.737196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:43.738855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:43.756480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1264/2553] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:43.762602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:43.772830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4348-9dfe-42be-914f-3d305b2b585f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:43.778005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:43.778659 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.778943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.779212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.779844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:43.781767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:43.872014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1290/2554] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:43 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:43.877193 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:43.888283 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63409f07-523b-4c33-b8bf-2abccb2cf08a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:43.952907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:43.953603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:43.953909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:43.954178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:43.954992 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:43.956941 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:44.030531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1265/2555] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:43 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:44.035446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:44.045754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c2760-3171-4467-b90d-44444a55076e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:44.051144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:44.051747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:44.052028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:44.052298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:44.052941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:44.054548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:44.065075 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1291/2556] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:44.069696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:44.080888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729100-bdeb-4e80-b5c8-0fd20aec90c4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:44.085594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:44.086200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:44.086505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:44.086779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:44.087477 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:44.088999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a949318-d865-44dd-b79f-910d6a4c355c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:44.100033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1266/2557] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:44.104433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:44.118905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a90e-367b-4b39-b528-906683ea4b0f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:44.123902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:44.124573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:44.124852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:44.125145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] PATH_INFO: `/v3/projects/bfd00e7a061644f3896baabca848bf46/users/9fbd81b4f6a643bea305f349488a097d/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:44.140768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd00e7a061644f3896baabca848bf46, user_id=9fbd81b4f6a643bea305f349488a097d, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:44.143503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:44.207779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1292/2558] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:44 2022] PUT /identity/v3/projects/bfd00e7a061644f3896baabca848bf46/users/9fbd81b4f6a643bea305f349488a097d/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:44.218459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:44.219905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:44.219905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:44.253089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] MFA Rules not processed for user `9fbd81b4f6a643bea305f349488a097d`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:44.254312 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:44.335456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1267/2559] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:44.346892 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:44.348814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:44.408016 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c147-08b2-4f08-99d3-1d2b8f21d016 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:44.414380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:44.414380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:44.415538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:44.415538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:44.424554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:44.426032 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d981cc-8f39-4804-ab63-9c0b771f9c40 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:44.435446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1293/2560] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:48.554757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:48.556386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:48.567100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:48.633195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9fb3-3ee5-4509-b3f4-cd50351279ef None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:48.637957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:48.638694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:48.638976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:48.639270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] PATH_INFO: `/v3/users/7fc17ba09079475ab44bd462c016291b` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:48.640409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc17ba09079475ab44bd462c016291b)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:48.643521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:48.849463 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc17ba09079475ab44bd462c016291b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.851140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc17ba09079475ab44bd462c016291b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.905299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc17ba09079475ab44bd462c016291b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.929446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc17ba09079475ab44bd462c016291b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.937569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc17ba09079475ab44bd462c016291b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.945290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1268/2561] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:48 2022] DELETE /identity/v3/users/7fc17ba09079475ab44bd462c016291b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:48.951073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:48.951587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:48.951828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:48.973415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:48.983453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:48.987073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.064940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1294/2562] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:49.077838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.077838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.148859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4d68-7194-43d6-82f8-205c97445848 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.152853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.153535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.153820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.154091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.166732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.168292 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903464e-a995-41e9-b298-053276acb6f3 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.181218 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1269/2563] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:49.616576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.618300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.636580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62b28-1e51-4763-9590-2cf9f33274d8 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.645460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.646399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.646609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.646895 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] PATH_INFO: `/v3/projects/8d4dd79dbf134c8aa46b564c8d6f184d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.648109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4dd79dbf134c8aa46b564c8d6f184d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.650298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.759388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4dd79dbf134c8aa46b564c8d6f184d', 'request_id': 'req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.842133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4dd79dbf134c8aa46b564c8d6f184d', 'request_id': 'req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.852144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4dd79dbf134c8aa46b564c8d6f184d', 'request_id': 'req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.863000 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] The token cache is being invalidate because project 8d4dd79dbf134c8aa46b564c8d6f184d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:49.863290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.863939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ba8d4fe3-2fea-4a93-aa64-774bc8bb79f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.865478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1295/2564] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:49 2022] DELETE /identity/v3/projects/8d4dd79dbf134c8aa46b564c8d6f184d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:49.870394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.871009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.871009 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.893318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:49.894596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.920160 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:49.956276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1270/2565] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:49.964302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.964780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.964982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.987084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:49.988349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:50.004565 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1296/2566] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:50.009189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.020178 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0271-b751-44fa-91bf-98f1ec0bbffc None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.026471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.027158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.028257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.028602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.029587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:50.029961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.031642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.048625 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1271/2567] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:50.051345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.061107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b758e-b869-4d7d-b92b-73bfccd1348b None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.067019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.068017 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.068705 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.069134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.070378 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.072778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.170142 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1297/2568] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:50 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:50.175213 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.185645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528552c6-cb44-4995-99e1-1e27c1e27490 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.248763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.249377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.249658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.249932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.250755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.254184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.349256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1272/2569] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:50 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:50.350555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.362028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd9e5-a60f-4b2c-a2c3-3d9e079e30cd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.367091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.367776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.368064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.368335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.368987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.370597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.383986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1298/2570] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:50.389241 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.400134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b5d2a-19e1-4003-9ada-8598388764a8 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.405751 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.406371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.406694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.406970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.407658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.409358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ddf3d-0f9c-4b1f-8d83-5d506836034d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.420282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1273/2571] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:50.425123 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.440932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d03c60-6448-4f6c-8e07-08199a1c1f68 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.441468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.442139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.442426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.442731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] PATH_INFO: `/v3/projects/79e62c7589624f6e86759cc1775cc50e/users/21dd834e932549fc87f92694f4cb13bf/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.458360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e62c7589624f6e86759cc1775cc50e, user_id=21dd834e932549fc87f92694f4cb13bf, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.461067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.540445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1299/2572] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:50 2022] PUT /identity/v3/projects/79e62c7589624f6e86759cc1775cc50e/users/21dd834e932549fc87f92694f4cb13bf/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:50.553501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.553892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.554296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.591519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] MFA Rules not processed for user `21dd834e932549fc87f92694f4cb13bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:50.592815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:50.668360 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1274/2573] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:50.672951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.706600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:50.743718 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2475f-ac0c-476f-9fe1-9cc2960fc25d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.748545 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.749243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.749531 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.749813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.750509 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.752517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.851267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1300/2574] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:50 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:50.855278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.867590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af50852-af39-4c81-975b-db6af1c56ab8 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.890315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:50.930806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.931629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.932130 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.932567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.933875 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.936077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.014982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1275/2575] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:50 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:51.019232 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.030309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e16ff-1035-419b-bae0-f54bbed03f0e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.038809 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.039812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.040275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.040639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.041303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.043002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.055283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1301/2576] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:51.060123 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.071600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1e71-9a76-485f-8309-f951cad74a31 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.076801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.077543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.077837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.078111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] PATH_INFO: `/v3/projects/4644badb1bcb453dba797e919d4d674f/users/115eef55d2be4d1287a659c295d56526/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.097600 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4644badb1bcb453dba797e919d4d674f, user_id=115eef55d2be4d1287a659c295d56526, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.100515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.169465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1276/2577] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:51 2022] PUT /identity/v3/projects/4644badb1bcb453dba797e919d4d674f/users/115eef55d2be4d1287a659c295d56526/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:51.175581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.187174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b173826-e934-43f4-9f22-9c23f121967c admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.264517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.265917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.265917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.265917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.266490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.268844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48caa7f-bca4-471d-913d-ac6be9ddf3a8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.280976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1302/2578] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:51.284892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.296367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e308d2-5a0f-4ccd-9357-a72a4ef75ea6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.301684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.302363 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.302684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.302956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] PATH_INFO: `/v3/projects/4644badb1bcb453dba797e919d4d674f/users/115eef55d2be4d1287a659c295d56526/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.304853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4644badb1bcb453dba797e919d4d674f, user_id=115eef55d2be4d1287a659c295d56526, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.307502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.319103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1277/2579] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:51 2022] PUT /identity/v3/projects/4644badb1bcb453dba797e919d4d674f/users/115eef55d2be4d1287a659c295d56526/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:51.332675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71e7d-3eeb-473f-91ca-bf1ac551adda None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.332675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71e7d-3eeb-473f-91ca-bf1ac551adda None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.332675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71e7d-3eeb-473f-91ca-bf1ac551adda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.368343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-96c71e7d-3eeb-473f-91ca-bf1ac551adda None None] MFA Rules not processed for user `115eef55d2be4d1287a659c295d56526`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:51.369158 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-96c71e7d-3eeb-473f-91ca-bf1ac551adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:51.445463 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1303/2580] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:51.456846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.458580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:51.527778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a51d1-889d-4d5c-8a42-70d9bb5d20ff admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.531997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.533795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.534099 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.534378 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.544790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.546242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.559937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1278/2581] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:51.560122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.560393 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.560671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.583706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:51.583706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:51.607738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:51.650647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1304/2582] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:51.664127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.667543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:51.668847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:51.670257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:51.750031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612547-da4c-497f-ba23-ebae6d77f102 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.751300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c035-24f2-4bbc-8fba-7d934eaf9d46 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:51.756725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.757359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.757643 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.757917 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] PATH_INFO: `/v3/users/9fbd81b4f6a643bea305f349488a097d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.758719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:51.759079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbd81b4f6a643bea305f349488a097d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.759744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:51.760470 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:51.760989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:51.761329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.771305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:51.772934 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539671a-7278-4133-a0a4-e7e9b0a1edf6 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:51.783105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1279/2583] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:02:51.987492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbd81b4f6a643bea305f349488a097d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:52.011439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbd81b4f6a643bea305f349488a097d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:52.012556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbd81b4f6a643bea305f349488a097d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:52.013219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbd81b4f6a643bea305f349488a097d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:52.117048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbd81b4f6a643bea305f349488a097d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:52.148476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1305/2584] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:51 2022] DELETE /identity/v3/users/9fbd81b4f6a643bea305f349488a097d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:52.155252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:52.156026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:52.156026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:52.178297 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:52.180007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:52.187191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:52.296148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1280/2585] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:52.305510 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:52.307182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:52.450963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:52.456404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfba2-342d-442d-8bda-955aa8177b1b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:52.460073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:52.473172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:52.473172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:52.473172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:52.473172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:52.473715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b014fb-1c8c-45f7-b532-aa2bb4fca534 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:52.486865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1306/2586] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:53.117688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:53.120016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:53.156372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d397d68-48b6-452e-b50b-ed6128e477fe None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:53.177879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:53.179304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.179592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.179869 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] PATH_INFO: `/v3/projects/bfd00e7a061644f3896baabca848bf46` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.181668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd00e7a061644f3896baabca848bf46)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:53.183802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:53.288280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd00e7a061644f3896baabca848bf46', 'request_id': 'req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:53.339464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd00e7a061644f3896baabca848bf46', 'request_id': 'req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:53.348356 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd00e7a061644f3896baabca848bf46', 'request_id': 'req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:53.362892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] The token cache is being invalidate because project bfd00e7a061644f3896baabca848bf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:53.363182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:53.363840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4f652e9e-45f7-4947-9a43-44e2d1d9b0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:53.369314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1281/2587] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:53 2022] DELETE /identity/v3/projects/bfd00e7a061644f3896baabca848bf46 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:53.372202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.372859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.372859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.396174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:53.397421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:53.475933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1307/2588] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:53.492227 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.492558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.492842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.518738 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:53.520619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:53.534511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1282/2589] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:53.536606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:53.547505 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532709d5-d42c-4d1b-99a3-780ba4bf3cc0 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:53.553291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:53.554139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.554540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.554888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.556859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:53.556859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:53.559548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:53.589323 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1308/2590] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:53.593874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:53.606162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405f40e-b13b-4726-a78f-407c4f125384 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:53.612815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:53.613988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.614681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.614681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.618317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:53.620746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:53.774866 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1283/2591] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:53 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:53.781691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:53.795115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa53f-b052-4567-8786-2825f9fb28cb admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:53.966303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:53.966303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.966303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.966303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.967031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:53.967031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:54.061732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1309/2592] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:53 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:54.075968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:54.104828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a8628-0fe1-4ade-af8f-2c6269935bbf admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:54.140166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:54.141648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:54.145348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:54.145555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:54.146341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:54.149800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:54.166010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1284/2593] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:54.170885 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:54.203858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c81328-c6cb-4121-9f49-78c1eb291e8f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:54.235029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:54.235620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:54.236430 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:54.236762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:54.237485 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:54.252157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808c347-5e34-4fd0-9a46-dc3daf566ecd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:54.271375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1310/2594] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:54.272696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:54.290176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a727-d10f-43d5-9f21-8e0edf948adb admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:54.326326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:54.327361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:54.329100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:54.330429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] PATH_INFO: `/v3/projects/1576876e71334789bae3616497e1e91b/users/391c0cd51e9c465090a21cea666098dc/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:54.363592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1576876e71334789bae3616497e1e91b, user_id=391c0cd51e9c465090a21cea666098dc, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:54.373316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:54.480191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1285/2595] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:54 2022] PUT /identity/v3/projects/1576876e71334789bae3616497e1e91b/users/391c0cd51e9c465090a21cea666098dc/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:54.492068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:54.492524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:54.492805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:54.540309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] MFA Rules not processed for user `391c0cd51e9c465090a21cea666098dc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:54.542597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:54.633962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:54.689090 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1311/2596] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:54.693920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:54.693920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:54.756662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:54.803307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeed1a-d857-4dd2-b231-6d93ba92b093 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:54.823511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:54.824552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:54.824966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:54.825822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:54.843645 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:54.845140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fafad-b4ff-442e-879a-cfe5087d7e18 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:54.866586 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1286/2597] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:55.149635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:55.151124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:55.278407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c26f6e-ee6b-49e5-bfb4-6dbf0fa4be30 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:55.283159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:55.283836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:55.284205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:55.284405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] PATH_INFO: `/v3/users/21dd834e932549fc87f92694f4cb13bf` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:55.285631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21dd834e932549fc87f92694f4cb13bf)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:55.287680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:55.549092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21dd834e932549fc87f92694f4cb13bf'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:55.565742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21dd834e932549fc87f92694f4cb13bf'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:55.567086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21dd834e932549fc87f92694f4cb13bf'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:55.570678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21dd834e932549fc87f92694f4cb13bf'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:55.656524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21dd834e932549fc87f92694f4cb13bf'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:55.672261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1312/2598] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:55 2022] DELETE /identity/v3/users/21dd834e932549fc87f92694f4cb13bf => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:55.677295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:55.678186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:55.678186 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:55.719326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:55.721429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:55.831274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1287/2599] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:55.848566 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:55.850265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:55.969224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6c709-acb9-4917-bca0-c7f6e265be89 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:55.974256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:55.975007 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:55.975482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:55.975829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:55.989491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:55.992205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:56.011974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1313/2600] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:56.525747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:56.527376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:56.578282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c9f6a-53dc-45df-8550-ec3f0db27944 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:56.584095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:56.584822 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:56.585109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:56.585383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] PATH_INFO: `/v3/projects/79e62c7589624f6e86759cc1775cc50e` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:56.586550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e62c7589624f6e86759cc1775cc50e)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:56.588485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:56.745234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e62c7589624f6e86759cc1775cc50e', 'request_id': 'req-06994dca-a479-4bb1-a5af-227731b0e624'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:56.865603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e62c7589624f6e86759cc1775cc50e', 'request_id': 'req-06994dca-a479-4bb1-a5af-227731b0e624'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:56.875433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e62c7589624f6e86759cc1775cc50e', 'request_id': 'req-06994dca-a479-4bb1-a5af-227731b0e624'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:56.889508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] The token cache is being invalidate because project 79e62c7589624f6e86759cc1775cc50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:56.889890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:56.890710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:56.896162 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1288/2601] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:56 2022] DELETE /identity/v3/projects/79e62c7589624f6e86759cc1775cc50e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:56.897557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:56.913434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8418c-4e3f-4676-93c6-324c7b4b22f5 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:56.913901 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:56.997030 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:56.997762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:56.998120 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:56.998398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] PATH_INFO: `/v3/users/115eef55d2be4d1287a659c295d56526` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:56.999800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=115eef55d2be4d1287a659c295d56526)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:57.011688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:57.259897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115eef55d2be4d1287a659c295d56526'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.274640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115eef55d2be4d1287a659c295d56526'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.275394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115eef55d2be4d1287a659c295d56526'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.276099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115eef55d2be4d1287a659c295d56526'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.345746 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ade65820-d3b5-450c-b42a-9db1b2fdb7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115eef55d2be4d1287a659c295d56526'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.370719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1314/2602] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:56 2022] DELETE /identity/v3/users/115eef55d2be4d1287a659c295d56526 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:58.107458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:58.109589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:58.134556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994dca-a479-4bb1-a5af-227731b0e624 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.234095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:58.241245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.242265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.242605 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.242889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] PATH_INFO: `/v3/projects/4644badb1bcb453dba797e919d4d674f` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.244124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4644badb1bcb453dba797e919d4d674f)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.246060 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:58.374310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4644badb1bcb453dba797e919d4d674f', 'request_id': 'req-8744f9ea-997b-4b80-b829-bda98b15dc92'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:58.465569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4644badb1bcb453dba797e919d4d674f', 'request_id': 'req-8744f9ea-997b-4b80-b829-bda98b15dc92'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:58.473732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4644badb1bcb453dba797e919d4d674f', 'request_id': 'req-8744f9ea-997b-4b80-b829-bda98b15dc92'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:58.489996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] The token cache is being invalidate because project 4644badb1bcb453dba797e919d4d674f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:58.490294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:58.490981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-8744f9ea-997b-4b80-b829-bda98b15dc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:58.496342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1289/2603] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:58 2022] DELETE /identity/v3/projects/4644badb1bcb453dba797e919d4d674f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:58.497988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.498547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.498642 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.532937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:58.532937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:58.618539 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1315/2604] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:58.628521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.628842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.629220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.654943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:58.656351 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:58.671873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1290/2605] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:58.672889 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:58.685053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2041d-22dc-46e8-bbb6-304cccfcdd3a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.692261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.692925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.693212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.693508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.694185 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:58.694544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.696356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:58.710432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1316/2606] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:02:58.714873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:58.725888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c99fa-332f-4ef1-a3eb-9b83fe918dac None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.733080 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.734007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.734296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.734742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.735551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.739044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:58.839643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1291/2607] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:58 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:58.843774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:58.862853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01c14a-f0cc-44a6-9740-247a1e7c5c18 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.888154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:58.989189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.990084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.990572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.991082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.991986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.994383 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.136050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1317/2608] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:58 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:59.140375 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.151237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3fe0-6325-4022-9669-eeb723163864 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.156040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.156668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.157020 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.157361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.158638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.160329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.171581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1292/2609] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:59.176802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.187150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e6ab-99e2-465c-ba63-631db87baa5e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.194794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.195648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.195939 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.196359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.197054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.199038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72fe2a-8ddb-40de-a45c-699979e82855 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.222730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.223019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1318/2610] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:59.240684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b6e8e-bbf6-4aac-8007-c0c364bfd12f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.248087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.248087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.248322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.248415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] PATH_INFO: `/v3/projects/31187d975e314f25ba55d786eb55efc1/users/9f70f69ea0524295b127e5efbe5def4e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.279453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31187d975e314f25ba55d786eb55efc1, user_id=9f70f69ea0524295b127e5efbe5def4e, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.284742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.388547 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1293/2611] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:59 2022] PUT /identity/v3/projects/31187d975e314f25ba55d786eb55efc1/users/9f70f69ea0524295b127e5efbe5def4e/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:59.399461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.399756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.400028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.440477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] MFA Rules not processed for user `9f70f69ea0524295b127e5efbe5def4e`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:59.442065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:59.555639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1319/2612] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:59.560048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.637911 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60749d9-8142-4dd3-b718-c5911fe237f0 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.643944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.644552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.644961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.645195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.646195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.648328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.953057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1294/2613] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/projects => generated 375 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:59.957456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.969287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee9edb-c8f2-4a5b-b7a9-ea099727b2a9 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.032952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.035164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.035164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.035164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.035529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.037325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.122074 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1320/2614] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:00.123345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.134410 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8938bb4-3c8a-44c9-98a8-7ea6226ab0a1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.139329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.139943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.140225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.140498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.141152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.142773 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.144426 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:00.155778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1295/2615] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:00.160005 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.170293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cb5c-a70e-4709-8ba8-f667bb7ac378 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.176057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.176992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.177282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.177558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] PATH_INFO: `/v3/projects/780cf3c3168d425eb7e468958cb7dfdd/users/c8254180fa3e43f389639713eb8ab386/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.195852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:00.202582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780cf3c3168d425eb7e468958cb7dfdd, user_id=c8254180fa3e43f389639713eb8ab386, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.205225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.306929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1321/2616] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:00 2022] PUT /identity/v3/projects/780cf3c3168d425eb7e468958cb7dfdd/users/c8254180fa3e43f389639713eb8ab386/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:00.311580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.324858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f95ad5-d774-4a5f-a320-fd38412c3787 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.401200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.401837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.402117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.402388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.403081 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.404730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85fc4e-70e6-41fb-9782-9a9b8608c4aa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.417170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1296/2617] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:00.422276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.433686 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652dbc-a29a-42f0-a0af-aa4bd5185eb5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.439979 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.440719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.445029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.445029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] PATH_INFO: `/v3/projects/780cf3c3168d425eb7e468958cb7dfdd/users/c8254180fa3e43f389639713eb8ab386/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.445029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780cf3c3168d425eb7e468958cb7dfdd, user_id=c8254180fa3e43f389639713eb8ab386, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.446266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.458336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1322/2618] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:00 2022] PUT /identity/v3/projects/780cf3c3168d425eb7e468958cb7dfdd/users/c8254180fa3e43f389639713eb8ab386/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:00.471055 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.471350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.471632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.501792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] MFA Rules not processed for user `c8254180fa3e43f389639713eb8ab386`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:00.503343 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:00.604754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1297/2619] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:00.617433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.619586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:00.689514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880d47b-354a-41e5-8352-e80b370e6e95 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.694071 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.694731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.695096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.695329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.756004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.757496 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6dea3-3fe4-41a7-9543-557801799b6a service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.767626 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1323/2620] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:04.096856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:04.110157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6cda-8e45-43ce-8402-ad07a9e4c3ee None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:04.116633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:04.117621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:04.117621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:04.117971 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:04.131333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:04.133806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:04.145679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1298/2621] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:07.160734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482de0a-2c50-48bd-8724-22f95c8c290b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:07.161330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482de0a-2c50-48bd-8724-22f95c8c290b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:07.161330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482de0a-2c50-48bd-8724-22f95c8c290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:07.184431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6482de0a-2c50-48bd-8724-22f95c8c290b None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:07.185680 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6482de0a-2c50-48bd-8724-22f95c8c290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:07.245337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1324/2622] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 15:03:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:07.267594 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:07.269032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:07.339492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555b3c-167e-42a4-9e25-b37751e18cf5 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:07.344957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:07.345700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:07.346133 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:07.346413 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:07.352357 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=100 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:07.356328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:07.357931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3d26-11c4-439e-9e69-4dea80dd6f0b service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:07.367220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1299/2623] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:03:08.217700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.218264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.218264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] PATH_INFO: `/` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.219637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1325/2624] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 15:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:03:08.226258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a83-5172-413d-a8fd-5868857e8134 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.227712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a83-5172-413d-a8fd-5868857e8134 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.227712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a83-5172-413d-a8fd-5868857e8134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.250569 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-6a1e4a83-5172-413d-a8fd-5868857e8134 None None] MFA Rules not processed for user `507ab70c63db42ffb6c77c02c58d1f37`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:08.251845 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-6a1e4a83-5172-413d-a8fd-5868857e8134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:08.330635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1300/2625] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:08.345354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:08.348195 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:08.364381 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3b8b-a95f-4213-8d30-f8cf628416da None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:08.368070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:08.368677 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.368958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.369230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.376621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:08.378035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cc3f-3b19-414a-be21-aca625656aab service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:08.386564 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1326/2626] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:08.471244 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba120-76cd-4e37-8dc8-17d0baf953bd None None] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.471765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba120-76cd-4e37-8dc8-17d0baf953bd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.472188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba120-76cd-4e37-8dc8-17d0baf953bd None None] PATH_INFO: `/` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.480694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1301/2627] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 30 15:03:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 15:03:08.480854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.480854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.480854 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.500906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] MFA Rules not processed for user `36f965f6675e44c3921178931ae00caf`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:08.502134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:08.522886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:08.574572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1327/2628] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 30 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:08.586694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba120-76cd-4e37-8dc8-17d0baf953bd None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:08.626409 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba120-76cd-4e37-8dc8-17d0baf953bd None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:08.631681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:08.636598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.636598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.636598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.648668 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:08.650779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4293aa-6030-40f4-a015-68650f7c0bc4 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:08.666843 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1302/2629] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:11.620571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:11.629270 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:11.695324 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325dd4-ab66-455f-8a79-1faf13a4af6e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:11.702041 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:11.702906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:11.703281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:11.703660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] PATH_INFO: `/v3/users/391c0cd51e9c465090a21cea666098dc` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:11.704994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] RBAC: Authorizing `identity:delete_user(user_id=391c0cd51e9c465090a21cea666098dc)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:11.707593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:11.910512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391c0cd51e9c465090a21cea666098dc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:11.936070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391c0cd51e9c465090a21cea666098dc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:11.936841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391c0cd51e9c465090a21cea666098dc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:11.937471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391c0cd51e9c465090a21cea666098dc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.020500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391c0cd51e9c465090a21cea666098dc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.034700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1328/2630] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:11 2022] DELETE /identity/v3/users/391c0cd51e9c465090a21cea666098dc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:12.039681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:12.040222 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:12.040338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:12.062105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:12.062902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:12.126307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1303/2631] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:12.136762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:12.138583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:12.173732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:12.198794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5ff7-d28f-4a04-9999-e25a2a0b397f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:12.202581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:12.203208 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:12.203491 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:12.203768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:12.213920 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:12.215474 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57902d-99a9-4018-a1cc-13f7ed1ec92a service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:12.226479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1329/2632] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:12.634694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:12.635868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:12.649092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b34ad2-6f98-4c5a-8c94-dd31598efa8d None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:12.654604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:12.655397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:12.655682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:12.655953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] PATH_INFO: `/v3/projects/1576876e71334789bae3616497e1e91b` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:12.657077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1576876e71334789bae3616497e1e91b)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:12.659329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:12.784957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1576876e71334789bae3616497e1e91b', 'request_id': 'req-30409f45-b511-47b5-80a3-dfd333319fca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.860284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1576876e71334789bae3616497e1e91b', 'request_id': 'req-30409f45-b511-47b5-80a3-dfd333319fca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.867597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1576876e71334789bae3616497e1e91b', 'request_id': 'req-30409f45-b511-47b5-80a3-dfd333319fca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.878046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] The token cache is being invalidate because project 1576876e71334789bae3616497e1e91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:12.878338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.879260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-30409f45-b511-47b5-80a3-dfd333319fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:12.880908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1304/2633] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:12 2022] DELETE /identity/v3/projects/1576876e71334789bae3616497e1e91b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:12.885974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:12.886435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:12.886551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:12.911868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:12.913073 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:12.977521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1330/2634] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:12.985445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:12.985690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:12.985963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.005995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:13.007249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:13.015965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1305/2635] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:13.028413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.040414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cfaf2-cc41-437e-a897-b12c8112f016 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.045069 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.045681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.045965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.046242 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.046951 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:13.047255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.048859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.061596 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1331/2636] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:13.068444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.077618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825c668-46b1-4231-9396-2ec8a3b3d4f6 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.083452 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.084057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.084369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.084643 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.085290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.087226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.091906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:13.250863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1306/2637] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:13 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:13.256260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.266903 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335d6d-86e7-4daf-9eea-200cb1a9a8ee admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.324663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.325271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.325552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.325827 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.326479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.328453 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.415797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1332/2638] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:13 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:13.420169 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.430991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba08d0-b192-41cc-8d30-aa4825bd5009 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.435627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.436230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.436703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.436980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.437623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.439427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.449507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1307/2639] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:13.453750 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.464627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccc61-5919-4847-95d9-bc6f566a47cf admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.469092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.469691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.469970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.470243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.471031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.473150 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667a956-21a7-421f-9d24-21327bc6770e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.483684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1333/2640] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:13.488100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.498943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a31d5-33e3-4802-b614-10936ccf3192 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.503695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.504304 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.504654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.504998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] PATH_INFO: `/v3/projects/07d611d04dd34420bf8524786deaf8b4/users/27035ff63b6c4ba9a13156dadb71b6fb/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.521259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d611d04dd34420bf8524786deaf8b4, user_id=27035ff63b6c4ba9a13156dadb71b6fb, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.524194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.638820 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1308/2641] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:13 2022] PUT /identity/v3/projects/07d611d04dd34420bf8524786deaf8b4/users/27035ff63b6c4ba9a13156dadb71b6fb/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:13.706973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.707264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.707572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.735079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] MFA Rules not processed for user `27035ff63b6c4ba9a13156dadb71b6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:13.736298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:13.766835 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:13.802829 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1334/2642] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:13.814134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.815850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:13.877451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea691b-594d-429c-9dcb-33d497924b92 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:13.881122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:13.881720 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:13.881998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:13.882267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:13.891296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:13.892723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:13.901509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1309/2643] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:19.921719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.964497 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.965887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.986688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d92ddc-07b5-4857-af87-bd145024262a None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.991546 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.992298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.992587 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.992866 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] PATH_INFO: `/v3/users/27035ff63b6c4ba9a13156dadb71b6fb` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.994085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27035ff63b6c4ba9a13156dadb71b6fb)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.996049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.033722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687004-b20d-49ce-afce-de287847955d service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.038752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.039390 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.039674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.039950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] PATH_INFO: `/v3/users/9f70f69ea0524295b127e5efbe5def4e` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.041092 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f70f69ea0524295b127e5efbe5def4e)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.043192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.210557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27035ff63b6c4ba9a13156dadb71b6fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.232974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27035ff63b6c4ba9a13156dadb71b6fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.233684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27035ff63b6c4ba9a13156dadb71b6fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.234569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27035ff63b6c4ba9a13156dadb71b6fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.236267 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f70f69ea0524295b127e5efbe5def4e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.236916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f70f69ea0524295b127e5efbe5def4e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.306885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f70f69ea0524295b127e5efbe5def4e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.308325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.322570 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f70f69ea0524295b127e5efbe5def4e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.331381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dd0f2a28-120b-4fc6-ae3f-603e4f8f125a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f70f69ea0524295b127e5efbe5def4e'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.338257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1310/2644] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:19 2022] DELETE /identity/v3/users/9f70f69ea0524295b127e5efbe5def4e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:20.342895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.343187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.343471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.365327 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:20.366588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.398631 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-39792945-bb0f-4b21-b4df-40559fd819c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27035ff63b6c4ba9a13156dadb71b6fb'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:20.412760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1335/2645] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:19 2022] DELETE /identity/v3/users/27035ff63b6c4ba9a13156dadb71b6fb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:20.422261 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.422576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.422915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.428978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1311/2646] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:20.440978 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.443229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.445139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:20.446415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.494601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.501257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d4155-46ab-4c7d-8457-63db71192edd None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.511276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1336/2647] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:20.521639 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.554760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.555401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.555686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.555965 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.571732 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.573181 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.579486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cf0cf-055e-493e-bf60-627253a949cc None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.583721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1312/2648] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:20.587595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.588599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.589039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.589456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.607154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.608696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.620524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1337/2649] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:21.198873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.198873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:21.211240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ab0fb-0e3f-4500-bd84-c5b9435e190f service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.215820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.217498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:21.219105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.219756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.220045 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.220324 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] PATH_INFO: `/v3/projects/31187d975e314f25ba55d786eb55efc1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.221465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31187d975e314f25ba55d786eb55efc1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.224951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.234940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42541a5-f0ef-470b-bb41-992156af7f92 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.240841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.241806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.244869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.244869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] PATH_INFO: `/v3/projects/07d611d04dd34420bf8524786deaf8b4` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.244869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d611d04dd34420bf8524786deaf8b4)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.245678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.296754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:21.312962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31187d975e314f25ba55d786eb55efc1', 'request_id': 'req-b9d0d2be-2940-4a81-b397-e04ad8500ca4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.359802 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d611d04dd34420bf8524786deaf8b4', 'request_id': 'req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.403754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31187d975e314f25ba55d786eb55efc1', 'request_id': 'req-b9d0d2be-2940-4a81-b397-e04ad8500ca4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.411719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31187d975e314f25ba55d786eb55efc1', 'request_id': 'req-b9d0d2be-2940-4a81-b397-e04ad8500ca4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.422657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] The token cache is being invalidate because project 31187d975e314f25ba55d786eb55efc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:21.422966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.423590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.425041 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1313/2650] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:21 2022] DELETE /identity/v3/projects/31187d975e314f25ba55d786eb55efc1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:21.429153 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.430510 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:21.449712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d611d04dd34420bf8524786deaf8b4', 'request_id': 'req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.458248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d611d04dd34420bf8524786deaf8b4', 'request_id': 'req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.474173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] The token cache is being invalidate because project 07d611d04dd34420bf8524786deaf8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:21.474554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.475226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.476870 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1338/2651] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:21 2022] DELETE /identity/v3/projects/07d611d04dd34420bf8524786deaf8b4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:21.502701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d2be-2940-4a81-b397-e04ad8500ca4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.572721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.573377 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.573702 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.573976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] PATH_INFO: `/v3/users/c8254180fa3e43f389639713eb8ab386` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.575442 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8254180fa3e43f389639713eb8ab386)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.577404 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.735030 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8254180fa3e43f389639713eb8ab386'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.735644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8254180fa3e43f389639713eb8ab386'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.815524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8254180fa3e43f389639713eb8ab386'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.823339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:21.828730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8254180fa3e43f389639713eb8ab386'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.836376 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-a2ee59d0-fe68-44e5-ae28-a21daea63b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8254180fa3e43f389639713eb8ab386'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:21.842367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1314/2652] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:21 2022] DELETE /identity/v3/users/c8254180fa3e43f389639713eb8ab386 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:22.296523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:22.298094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:22.311620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c779f-4c8c-4cf8-af04-0c3ecf055770 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:22.375454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:22.376084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.376363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.376635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] PATH_INFO: `/v3/projects/780cf3c3168d425eb7e468958cb7dfdd` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.377736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=780cf3c3168d425eb7e468958cb7dfdd)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:22.380184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:22.397321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:22.479302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780cf3c3168d425eb7e468958cb7dfdd', 'request_id': 'req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:22.553332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780cf3c3168d425eb7e468958cb7dfdd', 'request_id': 'req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:22.560745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780cf3c3168d425eb7e468958cb7dfdd', 'request_id': 'req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:22.572443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] The token cache is being invalidate because project 780cf3c3168d425eb7e468958cb7dfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:22.572726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:22.573508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3fccfc30-f301-4c5a-bcaf-61ad7346a5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:22.575019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1339/2653] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:22 2022] DELETE /identity/v3/projects/780cf3c3168d425eb7e468958cb7dfdd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:22.579912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.580445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.580445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.601804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:22.606841 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:22.667127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1315/2654] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:22.678354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.678662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.678937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.699725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:22.700948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:22.709132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1340/2655] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:22.713945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:22.724195 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a477-0e3e-42d2-8ce2-c15e2bd8047b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:22.729098 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:22.729694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.729972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.730243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.730935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:22.731233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:22.732821 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:22.745117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1316/2656] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:22.749683 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:22.761033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043e59-b77e-45f3-8d7e-417a1c9fc335 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:22.766173 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:22.766982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.767266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.767536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.768186 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:22.770217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:22.860928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1341/2657] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:22 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:22.866199 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:22.876543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbb4aa-1f52-4746-a584-664ccadb76a1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:22.935464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:22.936075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:22.936379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:22.936654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:22.937317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:22.939293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.085034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1317/2658] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:22 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:23.089389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.100392 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfcd-4bd8-4872-8c9f-8bafcefee9a2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.105202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.105850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.106136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.106413 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.107106 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.108721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.119882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1342/2659] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:23.124194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.134884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b96f3b-1c6a-4b9a-ba68-09cec875b91d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.140067 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.140672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.140955 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.141260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.141907 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.143531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89908d40-dfa0-48ac-85e5-83b80134665d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.154904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1318/2660] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:23.159118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.169950 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f39a-a95f-42cb-9463-e7545e3126f9 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.174606 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.175268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.175573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.175848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] PATH_INFO: `/v3/projects/fa92bd40ef1c451fab26625c3725a4c9/users/5484116fdb8c4e0a9084c85d701b1fba/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.192010 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa92bd40ef1c451fab26625c3725a4c9, user_id=5484116fdb8c4e0a9084c85d701b1fba, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.194831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.284623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1343/2661] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:23 2022] PUT /identity/v3/projects/fa92bd40ef1c451fab26625c3725a4c9/users/5484116fdb8c4e0a9084c85d701b1fba/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:23.296129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.296533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.296904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.325618 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] MFA Rules not processed for user `5484116fdb8c4e0a9084c85d701b1fba`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:23.326888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:23.364657 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:23.404165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1319/2662] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:23.408571 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.474230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11d020-703b-4880-a1e2-3ed149e17c48 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.479131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.479738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.480020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.480290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.480934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.482908 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.572037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1344/2663] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:23 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:23.576200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.589344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eca47-2fcb-4dee-9eb1-952f0788f205 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.656097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.656622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.656908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.657174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.657818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.659850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.759358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1320/2664] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:23 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:23.763648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.775400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e132e8-3920-4f4e-9f9e-a783e935e712 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.780252 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.780859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.781145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.781421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.782103 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.783818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.795217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1345/2665] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:23.799991 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.815792 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2a37-368c-48ac-bfc2-402b32f27e1a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.822338 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.823040 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.823321 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.823592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] PATH_INFO: `/v3/projects/df210a31d19c430ea71a0d597683062d/users/f56df46faaee43ccac69cb191650f0df/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.840644 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df210a31d19c430ea71a0d597683062d, user_id=f56df46faaee43ccac69cb191650f0df, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.843313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.931918 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1321/2666] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:23 2022] PUT /identity/v3/projects/df210a31d19c430ea71a0d597683062d/users/f56df46faaee43ccac69cb191650f0df/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:23.936147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.946635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1f706-0547-4e4d-bd7b-c2cce083967b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.960663 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:24.016815 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:24.017435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.017725 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.018002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.018690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:24.020806 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e6b89-74e2-4edb-b26d-ca9acce3c1d4 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:24.031499 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1346/2667] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:24.036403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:24.046983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353654e1-ac19-43f0-b5bb-bf6ee25a6af6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:24.051853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:24.052515 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.052825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.053100 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] PATH_INFO: `/v3/projects/df210a31d19c430ea71a0d597683062d/users/f56df46faaee43ccac69cb191650f0df/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.055073 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df210a31d19c430ea71a0d597683062d, user_id=f56df46faaee43ccac69cb191650f0df, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:24.057708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:24.069313 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1322/2668] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:24 2022] PUT /identity/v3/projects/df210a31d19c430ea71a0d597683062d/users/f56df46faaee43ccac69cb191650f0df/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:24.082368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.083271 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.083817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.113151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] MFA Rules not processed for user `f56df46faaee43ccac69cb191650f0df`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:24.114386 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:24.196948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1347/2669] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:24.209710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:24.211416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:24.282606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7ef2-3367-49d8-bc92-3e8a794f003f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:24.286889 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:24.287539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.287828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.288083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.335253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:24.350681 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:24.353106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:24.361322 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1323/2670] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:26.099139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:26.100557 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:26.112641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe525f2-f71a-40b1-8c1c-0537609d1c47 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:26.116360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:26.116972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:26.117258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:26.117529 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:26.126805 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:26.128228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011962fa-cc86-4557-9c48-0cddf3dfa877 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:26.138675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1348/2671] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:30.492646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.565581 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8797852-378c-453a-aba4-639dc222fe88 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.570860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.571579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.571860 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.572259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] PATH_INFO: `/v3/users/5484116fdb8c4e0a9084c85d701b1fba` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.573432 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5484116fdb8c4e0a9084c85d701b1fba)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.575774 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.704929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5484116fdb8c4e0a9084c85d701b1fba'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:30.705577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5484116fdb8c4e0a9084c85d701b1fba'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:30.758823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5484116fdb8c4e0a9084c85d701b1fba'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:30.776188 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5484116fdb8c4e0a9084c85d701b1fba'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:30.783234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5484116fdb8c4e0a9084c85d701b1fba'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:30.789781 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1324/2672] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:30 2022] DELETE /identity/v3/users/5484116fdb8c4e0a9084c85d701b1fba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:30.798241 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.798800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.798800 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.820417 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:30.821675 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:30.889254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1349/2673] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:30.900034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.901434 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:30.967316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda705-8e88-488a-9cac-89a2c8bc255a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.971198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.971808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.972091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.972362 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.982810 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.984253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.994935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1325/2674] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:31.464012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.469140 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:31.480170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbbcb9-4210-4915-9bd4-c4d82299333c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.493064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.493804 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.493918 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.494234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] PATH_INFO: `/v3/projects/fa92bd40ef1c451fab26625c3725a4c9` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.495451 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa92bd40ef1c451fab26625c3725a4c9)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.497874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.533630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:31.642455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa92bd40ef1c451fab26625c3725a4c9', 'request_id': 'req-fbc0d37e-4855-4b85-9475-bb97a8c239e5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:31.747236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa92bd40ef1c451fab26625c3725a4c9', 'request_id': 'req-fbc0d37e-4855-4b85-9475-bb97a8c239e5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:31.754206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa92bd40ef1c451fab26625c3725a4c9', 'request_id': 'req-fbc0d37e-4855-4b85-9475-bb97a8c239e5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:31.766089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] The token cache is being invalidate because project fa92bd40ef1c451fab26625c3725a4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:31.766370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:31.767172 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:31.768720 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1350/2675] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:31 2022] DELETE /identity/v3/projects/fa92bd40ef1c451fab26625c3725a4c9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:31.774310 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.780595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:31.784490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6805-0f55-42db-8ea5-6d0b5f2aa95c service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.848658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.849301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.849580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.849853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] PATH_INFO: `/v3/users/f56df46faaee43ccac69cb191650f0df` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.851519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56df46faaee43ccac69cb191650f0df)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.853620 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:32.103380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56df46faaee43ccac69cb191650f0df'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.104051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56df46faaee43ccac69cb191650f0df'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.170416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56df46faaee43ccac69cb191650f0df'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.183117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56df46faaee43ccac69cb191650f0df'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.189880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-7e77e578-2bd7-4332-95b6-6888eff92d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56df46faaee43ccac69cb191650f0df'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.197095 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1326/2676] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:31 2022] DELETE /identity/v3/users/f56df46faaee43ccac69cb191650f0df => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:32.618514 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:32.619853 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:32.635816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0d37e-4855-4b85-9475-bb97a8c239e5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:32.702651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:32.703293 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:32.703581 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:32.703852 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] PATH_INFO: `/v3/projects/df210a31d19c430ea71a0d597683062d` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:32.705021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df210a31d19c430ea71a0d597683062d)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:32.706968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:32.801774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df210a31d19c430ea71a0d597683062d', 'request_id': 'req-ca113715-f3ce-43e5-b174-4f79e529eea7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.850360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df210a31d19c430ea71a0d597683062d', 'request_id': 'req-ca113715-f3ce-43e5-b174-4f79e529eea7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.858679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df210a31d19c430ea71a0d597683062d', 'request_id': 'req-ca113715-f3ce-43e5-b174-4f79e529eea7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.871152 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] The token cache is being invalidate because project df210a31d19c430ea71a0d597683062d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:32.871446 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.872117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ca113715-f3ce-43e5-b174-4f79e529eea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:32.873610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1351/2677] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:32 2022] DELETE /identity/v3/projects/df210a31d19c430ea71a0d597683062d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:32.878648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399628-90eb-434b-8405-2bf272155efe None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:32.879139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399628-90eb-434b-8405-2bf272155efe None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:32.879245 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399628-90eb-434b-8405-2bf272155efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:32.900476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5c399628-90eb-434b-8405-2bf272155efe None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:32.901737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5c399628-90eb-434b-8405-2bf272155efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:32.961727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1327/2678] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:32.970109 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:32.970399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:32.970702 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:32.991558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:32.992763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:33.001008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1352/2679] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:33.006695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399628-90eb-434b-8405-2bf272155efe None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.017480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399628-90eb-434b-8405-2bf272155efe None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.022238 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.022874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.023179 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.023459 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.024176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:33.025033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.026747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.039315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1328/2680] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:33.045206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.058877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b18a4-4424-41fe-a3e8-8a9b84ffc712 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.063455 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.064117 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.064426 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.064699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.065343 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.067337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.160648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1353/2681] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:33.164872 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.175789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea097198-9f52-4b6b-b36e-7b270273abfc admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.184096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:33.235239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.235854 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.236134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.236420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.237054 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.239111 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.320269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1329/2682] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:33 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:33.325212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.336636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb4b0-b196-4190-a3ee-28ddd80693d3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.342102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.342748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.343025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.343298 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.343954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.345657 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.348133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:33.356912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1354/2683] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:33.361428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.372678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3db96-af34-4a5b-9a7a-65675e64a68d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.377520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.381462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.381462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.381462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.381462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.381462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e884ca-ae63-4b92-929e-e7293dda4e0c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.394370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1330/2684] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:33.398701 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.411255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb422a28-9d4c-44a4-b27d-086f603a2b46 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.417660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.418782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.418782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.419087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] PATH_INFO: `/v3/projects/4f79f08ff9d54436ba1c1df596de5e87/users/a73f3837948e4e379e17b8f6c0fb9809/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.435297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f79f08ff9d54436ba1c1df596de5e87, user_id=a73f3837948e4e379e17b8f6c0fb9809, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.437988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.531536 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1355/2685] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:33 2022] PUT /identity/v3/projects/4f79f08ff9d54436ba1c1df596de5e87/users/a73f3837948e4e379e17b8f6c0fb9809/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:33.543372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.543666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.543908 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.572520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] MFA Rules not processed for user `a73f3837948e4e379e17b8f6c0fb9809`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:33.573805 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:33.644050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1331/2686] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:33.648823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.717183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958b53-900d-4512-880b-3dd0b81f6835 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.721422 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.722037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.722321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.722627 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.723278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.725174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.814522 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1356/2687] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:33.818988 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.831439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61e7e-2ffe-44cd-b1a4-d386223fa53f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.889782 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.890490 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.890705 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.890982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.891637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.893557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.001270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1332/2688] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:33 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:34.005402 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.016240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a4c-376e-448e-8696-145f191455b7 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.021001 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.021604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.021884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.022154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.022834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.024420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.035521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1357/2689] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:34.040609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.051354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de527887-08a2-4dc1-932f-acc98f1bfeb9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.056913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.057614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.057896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.058215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.058926 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.060935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39247f8b-56c2-43f1-ae79-f448dca39ffc admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.063502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:34.073917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1333/2690] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:34.078336 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.095028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748a18-c37b-4ac5-b16a-1adaf261396e admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.101742 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.103423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.103974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.104481 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] PATH_INFO: `/v3/projects/aa3e00bd89cb4c17bb2d73b6aafada88/users/ba85141d087447b48eda82421d2e8480/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.128006 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3e00bd89cb4c17bb2d73b6aafada88, user_id=ba85141d087447b48eda82421d2e8480, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.130712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.189203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1358/2691] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:34 2022] PUT /identity/v3/projects/aa3e00bd89cb4c17bb2d73b6aafada88/users/ba85141d087447b48eda82421d2e8480/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:34.202389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.202942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.203444 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.235340 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] MFA Rules not processed for user `ba85141d087447b48eda82421d2e8480`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:34.236571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:34.303767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1334/2692] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:34.309316 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.375994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f3e4-c731-4cbb-a99a-0a75646b92d2 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.380703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.381315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.381604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.381877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.382544 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.385236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.474077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1359/2693] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:34 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:34.475325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.487031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ea345-2e0f-4760-955a-33b60c852c6c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.549759 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.550382 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.550695 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.550966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.551616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.553531 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.623201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1335/2694] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:34 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:34.627247 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.639055 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c020-d750-418d-ba69-ded199ceef71 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.643762 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.644369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.644668 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.644931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.645580 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.647902 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.650234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:34.659297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1360/2695] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:34.666752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.680276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a188b7-2502-481b-b666-d478d96a2b89 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.686744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.687421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.687704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.687982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] PATH_INFO: `/v3/projects/7256be97ceac4dff8e99219130842197/users/5e0d8e7ed9854525984c64ed0285aafc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.705191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7256be97ceac4dff8e99219130842197, user_id=5e0d8e7ed9854525984c64ed0285aafc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.707873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.777752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1336/2696] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:34 2022] PUT /identity/v3/projects/7256be97ceac4dff8e99219130842197/users/5e0d8e7ed9854525984c64ed0285aafc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:34.781996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.792955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c620925-9d6a-4bf4-86d4-d0a32769c720 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.853995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.854656 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.854945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.855215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.855873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.857464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c1bc-b3d8-473c-a57e-e2303336ea68 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.867403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1361/2697] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:34.872249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:34.883722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f2043-25cb-4cc8-ae05-71afeb56f984 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:34.890107 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:34.890798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.890798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.890959 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] PATH_INFO: `/v3/projects/7256be97ceac4dff8e99219130842197/users/5e0d8e7ed9854525984c64ed0285aafc/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.892916 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7256be97ceac4dff8e99219130842197, user_id=5e0d8e7ed9854525984c64ed0285aafc, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:34.895714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:34.907134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1337/2698] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:34 2022] PUT /identity/v3/projects/7256be97ceac4dff8e99219130842197/users/5e0d8e7ed9854525984c64ed0285aafc/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:34.918703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:34.919020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:34.919299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:34.950334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] MFA Rules not processed for user `5e0d8e7ed9854525984c64ed0285aafc`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:34.951590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:35.024525 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1362/2699] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:35.035583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:35.037482 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:35.082295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:35.097182 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168499b-23f8-4467-8697-e7430c5380f3 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:35.101270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:35.101880 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:35.102159 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:35.102464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:35.113388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:35.114863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:35.126002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1338/2700] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:36.138888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:36.140307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:36.153222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1d62-0dd7-4587-a1a3-08c30861f39e None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:36.157130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:36.157739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:36.158022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:36.158295 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:36.222454 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:36.224019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:36.234114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1363/2701] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:41.158380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:41.167246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50faf-1596-405b-80e5-7c3dc39e80da service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:41.171944 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:41.172682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:41.172873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:41.173152 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:41.239315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:41.240761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd998aa-cb37-46bb-a834-078c0416da54 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:41.251048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1339/2702] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:45.097203 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.134364 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:45.202398 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2353-5754-4d1c-a66a-2862a95859cb service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.209991 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.210935 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.211400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.215187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] PATH_INFO: `/v3/users/a73f3837948e4e379e17b8f6c0fb9809` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.215187 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73f3837948e4e379e17b8f6c0fb9809)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.215532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.444034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73f3837948e4e379e17b8f6c0fb9809'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.457307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73f3837948e4e379e17b8f6c0fb9809'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.461830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73f3837948e4e379e17b8f6c0fb9809'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.461830 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73f3837948e4e379e17b8f6c0fb9809'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.538062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73f3837948e4e379e17b8f6c0fb9809'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.553942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1364/2703] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:45 2022] DELETE /identity/v3/users/a73f3837948e4e379e17b8f6c0fb9809 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:45.558638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.559147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.559257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.586906 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:45.588177 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.649868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1340/2704] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:45.660645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.662233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.722731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612086f-3473-4245-9cba-835c2c208f75 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.726535 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.727148 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.727432 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.727703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.737014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.738467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.748844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1365/2705] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:46.195898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.198150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.215874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac111e-69e7-48f7-aa7b-36949f75eb4f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.221331 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.221972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.222256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.222680 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] PATH_INFO: `/v3/projects/4f79f08ff9d54436ba1c1df596de5e87` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.224979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f79f08ff9d54436ba1c1df596de5e87)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.227014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.318101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f79f08ff9d54436ba1c1df596de5e87', 'request_id': 'req-c5f2eced-63ab-4042-9ee8-dbf905dda95b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.382251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f79f08ff9d54436ba1c1df596de5e87', 'request_id': 'req-c5f2eced-63ab-4042-9ee8-dbf905dda95b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.390932 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f79f08ff9d54436ba1c1df596de5e87', 'request_id': 'req-c5f2eced-63ab-4042-9ee8-dbf905dda95b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.402650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] The token cache is being invalidate because project 4f79f08ff9d54436ba1c1df596de5e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:46.402954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.403641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.405342 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1341/2706] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:46 2022] DELETE /identity/v3/projects/4f79f08ff9d54436ba1c1df596de5e87 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:46.409345 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.419216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efa136-e5ba-4a7d-9a98-e915bdac2602 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.463797 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:46.495608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.496259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.496549 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.496821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] PATH_INFO: `/v3/users/ba85141d087447b48eda82421d2e8480` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.498082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba85141d087447b48eda82421d2e8480)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.500597 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.659361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba85141d087447b48eda82421d2e8480'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.673118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba85141d087447b48eda82421d2e8480'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.674119 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba85141d087447b48eda82421d2e8480'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.674758 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba85141d087447b48eda82421d2e8480'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.714649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba85141d087447b48eda82421d2e8480'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.731441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1366/2707] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:46 2022] DELETE /identity/v3/users/ba85141d087447b48eda82421d2e8480 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:47.178701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.184800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:47.191640 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:47.196882 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2eced-63ab-4042-9ee8-dbf905dda95b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.286406 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.287065 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.287345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.287684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] PATH_INFO: `/v3/projects/aa3e00bd89cb4c17bb2d73b6aafada88` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.288811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3e00bd89cb4c17bb2d73b6aafada88)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.290848 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.382766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3e00bd89cb4c17bb2d73b6aafada88', 'request_id': 'req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.462825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3e00bd89cb4c17bb2d73b6aafada88', 'request_id': 'req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.474749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3e00bd89cb4c17bb2d73b6aafada88', 'request_id': 'req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.485233 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] The token cache is being invalidate because project aa3e00bd89cb4c17bb2d73b6aafada88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:47.485532 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.486198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.487730 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1342/2708] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:47 2022] DELETE /identity/v3/projects/aa3e00bd89cb4c17bb2d73b6aafada88 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:47.491782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.493189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:47.509147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cfc6-88f5-48ec-b30d-2cc372a934f8 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.572621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.573375 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.573681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.573994 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] PATH_INFO: `/v3/users/5e0d8e7ed9854525984c64ed0285aafc` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.575257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0d8e7ed9854525984c64ed0285aafc)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.577211 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.764138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0d8e7ed9854525984c64ed0285aafc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.779370 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:47.783094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0d8e7ed9854525984c64ed0285aafc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.783858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0d8e7ed9854525984c64ed0285aafc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.784470 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0d8e7ed9854525984c64ed0285aafc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.891344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-ef3fd36e-7446-4c06-a8bc-ae8b37d8d68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0d8e7ed9854525984c64ed0285aafc'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.904411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1367/2709] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:47 2022] DELETE /identity/v3/users/5e0d8e7ed9854525984c64ed0285aafc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:48.304807 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.308302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.321943 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931a5c-7c1d-40e2-825e-bc52e24f2aef admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.385302 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.386091 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.386709 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.387085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] PATH_INFO: `/v3/projects/7256be97ceac4dff8e99219130842197` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.388494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7256be97ceac4dff8e99219130842197)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.390790 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.465671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:48.476237 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7256be97ceac4dff8e99219130842197', 'request_id': 'req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.531010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7256be97ceac4dff8e99219130842197', 'request_id': 'req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.538648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7256be97ceac4dff8e99219130842197', 'request_id': 'req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.550796 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] The token cache is being invalidate because project 7256be97ceac4dff8e99219130842197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:48.551097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.551837 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-29b1bb76-1408-4f7e-ba71-5a7d06f1bd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.553601 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1343/2710] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:48 2022] DELETE /identity/v3/projects/7256be97ceac4dff8e99219130842197 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:48.559715 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.560251 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.560340 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.587641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:48.588983 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.658149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1368/2711] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:48.726284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.726596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.726870 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.747120 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:48.748326 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.757257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1344/2712] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:48.765167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.773306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb3f3-560d-4688-8aba-2f0ab0253684 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.782433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.782433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.782433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.782433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.782881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:48.782881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.782881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.795205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1369/2713] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:48.799930 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.818817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01a439-e428-45a0-a081-97bba8caeec0 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.823641 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.824262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.824550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.824832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.825492 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.827462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.935485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1345/2714] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:48.940789 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.951112 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996238-e3c8-4a36-a927-d8e34db43d5d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.012149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.012821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.013085 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.013360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.014260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.016200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.126527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1370/2715] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:49.130677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.141588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951b606-4771-41a6-ab07-4b05782ec301 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.146458 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.147114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.147392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.147660 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.148300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.149885 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.160451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1346/2716] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:49.169389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.181584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d23b-e1a0-453c-bb49-9cff7095aacd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.186387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.187026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.187311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.187608 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.188862 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.190548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606d336-b52d-4ae5-bd87-ff11f6415023 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.201265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1371/2717] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:49.205526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.215669 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c83d8-1966-4030-bb3c-61311fe30efa admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.225315 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.226014 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.226247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.226549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] PATH_INFO: `/v3/projects/a8666ef4a3654340a34abd31ce46b1c9/users/e9c186384afe4efe9559df3f856d5c98/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.244417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8666ef4a3654340a34abd31ce46b1c9, user_id=e9c186384afe4efe9559df3f856d5c98, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.247119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.337265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1347/2718] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:49 2022] PUT /identity/v3/projects/a8666ef4a3654340a34abd31ce46b1c9/users/e9c186384afe4efe9559df3f856d5c98/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:49.349857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.350138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.350414 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.380710 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] MFA Rules not processed for user `e9c186384afe4efe9559df3f856d5c98`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:49.381865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:49.417362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:49.450415 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1372/2719] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:49.461808 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.463538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:49.527450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf16409-1621-4d70-8729-2d7b76b7a21c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.531341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.532478 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.532827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.533150 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.542083 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.543617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.553883 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1348/2720] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:49.980609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.982116 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.042905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7949e0d-ec05-410d-a25e-6b774a232b26 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:50.046813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:50.053212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:50.053212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:50.053212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:50.053212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.132530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:50.133988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eada1-4d92-46f1-8874-5549073c0cc0 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:50.146095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1373/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:53.606740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.620688 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530584c-9ea4-4ca9-b6df-e68e01d63999 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.626217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.626996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.627435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.627663 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] PATH_INFO: `/v3/users/e9c186384afe4efe9559df3f856d5c98` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.628858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c186384afe4efe9559df3f856d5c98)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.630799 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.770560 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c186384afe4efe9559df3f856d5c98'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.771225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c186384afe4efe9559df3f856d5c98'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.856538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c186384afe4efe9559df3f856d5c98'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.862272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:53.870521 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c186384afe4efe9559df3f856d5c98'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.888753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c186384afe4efe9559df3f856d5c98'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.895549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1349/2722] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:53 2022] DELETE /identity/v3/users/e9c186384afe4efe9559df3f856d5c98 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:53.900014 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.900492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.900592 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.920615 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:53.921839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:53.968270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.970533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:53.987810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1374/2723] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:53.997530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.998937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.027357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.041308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018302-d712-4c55-8ce5-91b92ab95bab admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.048210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.048884 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.049194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.049471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] PATH_INFO: `/v3/users/c8072b6bbaad4d4780ecf3ca96d098f5` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.050633 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8072b6bbaad4d4780ecf3ca96d098f5)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.052534 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.057554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082aaa9-fd64-4352-9453-ad1d8cffdb21 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.061767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.062096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.062382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.062735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.072107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.073572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.084199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1375/2724] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:54.252945 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8072b6bbaad4d4780ecf3ca96d098f5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.253611 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8072b6bbaad4d4780ecf3ca96d098f5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.326131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8072b6bbaad4d4780ecf3ca96d098f5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.339811 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8072b6bbaad4d4780ecf3ca96d098f5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.347651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8072b6bbaad4d4780ecf3ca96d098f5'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.353812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1350/2725] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:53 2022] DELETE /identity/v3/users/c8072b6bbaad4d4780ecf3ca96d098f5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:54.493921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.495457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.513215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d092-b393-4de4-9934-db548294df9d service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.573782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.574466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.574754 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.575023 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] PATH_INFO: `/v3/projects/a8666ef4a3654340a34abd31ce46b1c9` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.576138 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8666ef4a3654340a34abd31ce46b1c9)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.578018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.590506 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.597420 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.608096 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6989d-9202-4d7e-aa43-dc19ab568795 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.615953 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.616435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.616713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.617028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] PATH_INFO: `/v3/projects/3f81e65b01fc4f508ff1843688f63020` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.618198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f81e65b01fc4f508ff1843688f63020)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.620348 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.707913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8666ef4a3654340a34abd31ce46b1c9', 'request_id': 'req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.807655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f81e65b01fc4f508ff1843688f63020', 'request_id': 'req-4ba7900f-9f80-4250-a766-adde3cb0ebae'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.809437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.811219 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8666ef4a3654340a34abd31ce46b1c9', 'request_id': 'req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.818248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8666ef4a3654340a34abd31ce46b1c9', 'request_id': 'req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.829666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] The token cache is being invalidate because project a8666ef4a3654340a34abd31ce46b1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:54.830088 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.830774 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-6c1ae4ae-c106-421f-93c2-0a8ceef924d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.832267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1376/2726] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:54 2022] DELETE /identity/v3/projects/a8666ef4a3654340a34abd31ce46b1c9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:54.838246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae305f5-27a3-4b57-9543-0a1db1b5cd43 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.838576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae305f5-27a3-4b57-9543-0a1db1b5cd43 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.838874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae305f5-27a3-4b57-9543-0a1db1b5cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.861038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5ae305f5-27a3-4b57-9543-0a1db1b5cd43 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:54.862230 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5ae305f5-27a3-4b57-9543-0a1db1b5cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.914157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f81e65b01fc4f508ff1843688f63020', 'request_id': 'req-4ba7900f-9f80-4250-a766-adde3cb0ebae'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.915401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.921740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f81e65b01fc4f508ff1843688f63020', 'request_id': 'req-4ba7900f-9f80-4250-a766-adde3cb0ebae'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.925404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1377/2727] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:54.933255 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.933547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.933727 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] The token cache is being invalidate because project 3f81e65b01fc4f508ff1843688f63020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:54.933844 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.934025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.934711 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-4ba7900f-9f80-4250-a766-adde3cb0ebae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:54.936403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1351/2728] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:54 2022] DELETE /identity/v3/projects/3f81e65b01fc4f508ff1843688f63020 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:54.940740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd822b8-489d-459d-8466-8b5563633226 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.941052 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd822b8-489d-459d-8466-8b5563633226 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.941317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd822b8-489d-459d-8466-8b5563633226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.955144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:54.956368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.960855 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2fd822b8-489d-459d-8466-8b5563633226 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:54.961982 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2fd822b8-489d-459d-8466-8b5563633226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.964523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1378/2729] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:54.968601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.971658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1352/2730] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:54.978934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2784b-df6e-4e06-a990-f1d5542219be None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.979265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.979555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.979831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.984048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.984714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.985052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.985326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.986082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:54.986405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.988026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.999688 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1379/2731] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:54.999896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:55.001505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:55.003975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.010085 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1353/2732] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:55.014372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.019038 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f38f-db30-4185-8d1d-77b6bc40f5df admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.020062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.020696 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.021002 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.021281 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.021919 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.023985 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.024967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02798ed9-0e96-41c1-90b8-d37b2d18a377 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.029614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.030215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.030511 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.030788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.031433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:55.032341 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.034121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.046748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1354/2733] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:55.051141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.060565 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db660b-7a9a-4824-a081-23f57b86bee1 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.065740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.066320 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.066689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.066963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.067587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.069461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.121127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1380/2734] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.125189 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.153074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1355/2735] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.154077 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.189196 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5393e-a8c2-4608-b021-7603c0020e3a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.217995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeffb7-d612-4366-a8e9-af15e2286d20 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.222675 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.223287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.223589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.223863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.224503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.226621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.247265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.251807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.251807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.251807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.251807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.251807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.291502 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1356/2736] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:55.295552 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.305119 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea6fc-5977-450e-8073-59d3643dcde6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.310103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.310737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.311023 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.311293 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.311931 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.314652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.325057 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1357/2737] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:55.329629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1381/2738] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.329800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.335873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.339933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24cc6-a341-4a75-9fda-8962f9f66869 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.344784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.345385 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.345666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.345942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.346280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbdd7c-f2c0-4e2b-8ca9-0a36c2baf337 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.346651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.348234 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.351139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.355922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.355922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.355922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.355922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.355922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.359164 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1358/2739] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:55.363281 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.365388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1382/2740] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:55.369135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.373780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932269-aa1b-4a26-8cc2-941fba1cff9f admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.378933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.379679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.379814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a86b8-a734-4c0b-b4d3-9951087655e6 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.379970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.380243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] PATH_INFO: `/v3/projects/e6f703c1583f4fda9d86be5eb1a435a8/users/6dc5094775df445b941a8b2761053696/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.384366 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.384942 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.385223 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.385492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.386121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.387736 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.396231 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f703c1583f4fda9d86be5eb1a435a8, user_id=6dc5094775df445b941a8b2761053696, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.398909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b143f8-48e9-475b-a473-9680ab4caff1 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.399647 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1383/2741] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:55.405682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.416408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c608-9f56-4daa-81c3-325e20875280 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.421361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.422034 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.422548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.422731 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] PATH_INFO: `/v3/projects/7f313185d28743f2878d19d4e9116f8e/users/e3f8c6524c7d48b9a38dc0e6e4422485/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.437359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f313185d28743f2878d19d4e9116f8e, user_id=e3f8c6524c7d48b9a38dc0e6e4422485, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.441925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af5e0-1afc-4a72-85d9-d15e12f36b44 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.475780 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1359/2742] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:55 2022] PUT /identity/v3/projects/e6f703c1583f4fda9d86be5eb1a435a8/users/6dc5094775df445b941a8b2761053696/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:55.486079 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.486371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.486700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.497024 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1384/2743] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:55 2022] PUT /identity/v3/projects/7f313185d28743f2878d19d4e9116f8e/users/e3f8c6524c7d48b9a38dc0e6e4422485/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:55.513831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.514371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.514693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.515708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] MFA Rules not processed for user `6dc5094775df445b941a8b2761053696`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:55.517752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:55.528958 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:55.539786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:55.544067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] MFA Rules not processed for user `e3f8c6524c7d48b9a38dc0e6e4422485`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:55.545291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:55.587018 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1360/2744] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:55.591587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.616620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1385/2745] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:55.621175 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.659630 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892aec-b9e3-4d87-9dfd-a9b19c6e9265 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.664372 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.664985 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.665262 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.665533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.666168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.668428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.684053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602bb60-d7c7-4585-ae54-bc32ba5984e2 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.689548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.690156 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.690466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.690744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.691427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.693359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.760862 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1361/2746] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.765243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.779405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1386/2747] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.783740 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.834526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53421-3d15-4343-bef9-7033ff7c80a9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.853932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2535-03bb-4961-b24f-e5c4d454f319 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.858927 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.860475 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.860761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.861031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.861694 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.864084 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.886635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:55.894093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.894739 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.895026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.895295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.895927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.897888 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.937519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1387/2748] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:55.942469 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.952166 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0149f-f1bd-4300-925b-bab3d5601938 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.957357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.957941 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.958306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.958620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.959263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.960845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.966248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:55.972012 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1388/2749] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:55.975756 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.986039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f684-b9c4-4a50-8480-256d71fb2c8b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.990744 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.991314 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.991603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.993037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.993037 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.994087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.005757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1389/2750] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:56.009882 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.018284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1362/2751] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:55 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:56.019785 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f6e4-fac9-4228-a15c-d825c5674944 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.022256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.024654 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.029355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.029355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.029355 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] PATH_INFO: `/v3/projects/4c6b3d37875d49b98225d8f72a41def2/users/641888d7015b4151bbcdc1b6fda7fa8f/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.033243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39570-9748-477b-a30b-b47b23a2878b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.037997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.038639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.038962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.039290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.039946 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.041217 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6b3d37875d49b98225d8f72a41def2, user_id=641888d7015b4151bbcdc1b6fda7fa8f, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.041535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.043881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a13d-cda0-4a20-841c-4d0a93099e3d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.052642 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1363/2752] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:56.057046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.067226 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08bca-9683-4f75-8574-26f21b0e1faa admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.071863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.072533 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.072972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.073246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] PATH_INFO: `/v3/projects/50e1f4034607496786f747c54db63544/users/7230e0938f914a8fbe2c253072766d37/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.088056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1f4034607496786f747c54db63544, user_id=7230e0938f914a8fbe2c253072766d37, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.090890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.114987 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1390/2753] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:56 2022] PUT /identity/v3/projects/4c6b3d37875d49b98225d8f72a41def2/users/641888d7015b4151bbcdc1b6fda7fa8f/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:56.125022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.125610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.125610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.143489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1364/2754] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:56 2022] PUT /identity/v3/projects/50e1f4034607496786f747c54db63544/users/7230e0938f914a8fbe2c253072766d37/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:56.151088 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.155471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] MFA Rules not processed for user `641888d7015b4151bbcdc1b6fda7fa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:56.157177 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.213829 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b5cf7-f2c4-4049-9a9c-f7aa7f72b9d2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.218977 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.220129 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.220433 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.220684 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.221334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.222961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.223301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1391/2755] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:56.227822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.237029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1365/2756] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:56.238963 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.239198 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b033-974e-4aab-99d4-8b66b0f60c17 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.243923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.244530 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.244841 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.245118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.245760 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.247881 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.248543 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a853647-87e0-4e08-aea2-8c86f872b983 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.253255 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.253896 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.254183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.254484 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] PATH_INFO: `/v3/projects/50e1f4034607496786f747c54db63544/users/7230e0938f914a8fbe2c253072766d37/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.256414 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1f4034607496786f747c54db63544, user_id=7230e0938f914a8fbe2c253072766d37, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.259131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9e016-346d-4871-ae21-22d07e3543cf admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.269710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1366/2757] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:56 2022] PUT /identity/v3/projects/50e1f4034607496786f747c54db63544/users/7230e0938f914a8fbe2c253072766d37/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:56.285295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.285587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.285865 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.313993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] MFA Rules not processed for user `7230e0938f914a8fbe2c253072766d37`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:56.315268 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.333556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1392/2758] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:56.338604 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.386737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1367/2759] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:56.398974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.400329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.402779 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8024f-2f64-4165-b9a6-57530c231cbd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.408353 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.408962 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.409246 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.409526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.410154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.412089 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.421366 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:56.459897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d738ed5-2fcf-4c49-93fb-5cff23f5a7a7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.508025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.508635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.508919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.509194 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.530009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1393/2760] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:56.530476 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.541482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b8064-be6d-4aea-931e-2e7709625c8a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.547909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.547909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.548260 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.548541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.549214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.550911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.565540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1394/2761] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:56.566641 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.575235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.576784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.576932 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8843-39c0-4624-86c3-5ff299dd37bc admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.581943 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.582700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.582990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.587838 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] PATH_INFO: `/v3/projects/04649ac944554231ad6fd9c3991580e8/users/31c74891a5024ca48454d2af960e3cb8/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.587981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1368/2762] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:56.592493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:56.599306 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04649ac944554231ad6fd9c3991580e8, user_id=31c74891a5024ca48454d2af960e3cb8, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.602125 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.686738 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1395/2763] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:56 2022] PUT /identity/v3/projects/04649ac944554231ad6fd9c3991580e8/users/31c74891a5024ca48454d2af960e3cb8/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:56.694069 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.704473 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15413a6f-e29c-46e8-99cf-7bcf05556f43 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.757433 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.766128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.766956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.767239 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.767509 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.768157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.769770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.779571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1369/2764] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:56.784265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.793761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c5eb-acfd-4c27-990e-f8a101350d7e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.799980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.800614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.800895 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.801167 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] PATH_INFO: `/v3/projects/04649ac944554231ad6fd9c3991580e8/users/31c74891a5024ca48454d2af960e3cb8/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.803101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04649ac944554231ad6fd9c3991580e8, user_id=31c74891a5024ca48454d2af960e3cb8, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.805731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547438e-b658-4c18-86d1-d3a12c57e970 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.816435 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1370/2765] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:56 2022] PUT /identity/v3/projects/04649ac944554231ad6fd9c3991580e8/users/31c74891a5024ca48454d2af960e3cb8/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:56.819843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f6b0-2b69-445e-aae1-98b9d751fe04 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.827682 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.827962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.828229 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.842198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:56.857998 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] MFA Rules not processed for user `31c74891a5024ca48454d2af960e3cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:56.859251 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.877118 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.877734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.878021 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.878300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.930604 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1371/2766] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:56.935767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.937191 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.942476 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.943892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.947254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1396/2767] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:56.956134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17899e-81f3-4473-9ce2-fe88c3891e55 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.960082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.960690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.960975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.961246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:57.021827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:57.023290 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:57.032800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1372/2768] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:58.884768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.894240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efcf60-8692-46e3-95e1-b5091952bdfb service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.898067 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.898726 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.899004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.899282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.963925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:58.966134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.967610 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.977335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1397/2769] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:00.453802 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:00.463892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13662bd-57c9-48ea-929f-5421d4c777ca service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:00.468249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:00.468249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:00.468501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:00.468714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:00.478767 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:00.480192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:00.490071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1373/2770] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:05.251376 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:05.318640 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fee8b6-3c12-4d76-bec2-4cf47454e88f service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:05.323586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:05.324278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:05.324569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:05.324848 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] PATH_INFO: `/v3/users/e3f8c6524c7d48b9a38dc0e6e4422485` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:05.325982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f8c6524c7d48b9a38dc0e6e4422485)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:05.327965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:05.472105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:05.483261 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676730-083e-46b9-a10c-adac342595a7 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:05.492124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:05.492124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:05.492124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:05.492124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] PATH_INFO: `/v3/users/6dc5094775df445b941a8b2761053696` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:05.492597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc5094775df445b941a8b2761053696)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:05.492597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:05.550807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f8c6524c7d48b9a38dc0e6e4422485'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.563020 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f8c6524c7d48b9a38dc0e6e4422485'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.563681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f8c6524c7d48b9a38dc0e6e4422485'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.564282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f8c6524c7d48b9a38dc0e6e4422485'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.640313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-a94e44cf-edeb-4c62-94db-0af830a43dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f8c6524c7d48b9a38dc0e6e4422485'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.654205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1398/2771] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:05 2022] DELETE /identity/v3/users/e3f8c6524c7d48b9a38dc0e6e4422485 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:05.658685 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:05.658993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:05.659272 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:05.678028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:05.679344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:05.730647 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc5094775df445b941a8b2761053696'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.731392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc5094775df445b941a8b2761053696'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.737087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1399/2772] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:05.746981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:05.748360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:05.766988 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:05.805136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1945e-c90b-41cd-b84b-a67742a91ae7 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:05.808684 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:05.809297 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:05.809579 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:05.809877 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:05.811379 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc5094775df445b941a8b2761053696'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.820337 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:05.821769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269711e-e49c-48de-ac38-65f6be51749c service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:05.825269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc5094775df445b941a8b2761053696'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.826501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:05.832796 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1400/2773] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:04:05.834747 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc5094775df445b941a8b2761053696'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:05.840789 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1374/2774] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:05 2022] DELETE /identity/v3/users/6dc5094775df445b941a8b2761053696 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:05.845286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:05.848768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:05.848768 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:05.869379 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:05.870799 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:05.932439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1401/2775] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:05.942393 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:05.997858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30ebf-e6bf-467e-8c5e-85c70a18845c admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:06.001489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:06.002089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:06.002371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:06.002673 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:06.011535 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:06.012954 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:06.024004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1375/2776] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:06.287845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:06.289389 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:06.302307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8dced-0c15-4ed3-836b-80d0b69cdf51 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:06.307130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:06.307763 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:06.308050 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:06.308327 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] PATH_INFO: `/v3/projects/7f313185d28743f2878d19d4e9116f8e` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:06.309441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f313185d28743f2878d19d4e9116f8e)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:06.311391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:06.419461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f313185d28743f2878d19d4e9116f8e', 'request_id': 'req-4f489fcb-be0a-4f68-9147-1e2278bf1e33'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.476703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:06.478145 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:06.480318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f313185d28743f2878d19d4e9116f8e', 'request_id': 'req-4f489fcb-be0a-4f68-9147-1e2278bf1e33'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.492954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f313185d28743f2878d19d4e9116f8e', 'request_id': 'req-4f489fcb-be0a-4f68-9147-1e2278bf1e33'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.493103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511044ec-828b-4f5c-be5d-e234168d9442 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:06.514354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] The token cache is being invalidate because project 7f313185d28743f2878d19d4e9116f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:06.514930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.515624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.517136 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1402/2777] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:06 2022] DELETE /identity/v3/projects/7f313185d28743f2878d19d4e9116f8e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:06.521238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:06.522503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:06.560257 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:06.560892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:06.561173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:06.561445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] PATH_INFO: `/v3/projects/e6f703c1583f4fda9d86be5eb1a435a8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:06.562608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f703c1583f4fda9d86be5eb1a435a8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:06.564662 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:06.568910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:06.587717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f489fcb-be0a-4f68-9147-1e2278bf1e33 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:06.592551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:06.593319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:06.593603 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:06.593880 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] PATH_INFO: `/v3/users/641888d7015b4151bbcdc1b6fda7fa8f` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:06.595048 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641888d7015b4151bbcdc1b6fda7fa8f)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:06.596968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:06.682755 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f703c1583f4fda9d86be5eb1a435a8', 'request_id': 'req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.777592 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f703c1583f4fda9d86be5eb1a435a8', 'request_id': 'req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.785606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f703c1583f4fda9d86be5eb1a435a8', 'request_id': 'req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.792512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641888d7015b4151bbcdc1b6fda7fa8f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.796465 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] The token cache is being invalidate because project e6f703c1583f4fda9d86be5eb1a435a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:06.796761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.797395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.798935 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1376/2778] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:06 2022] DELETE /identity/v3/projects/e6f703c1583f4fda9d86be5eb1a435a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:06.802910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:06.804246 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:06.805922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641888d7015b4151bbcdc1b6fda7fa8f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.806649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641888d7015b4151bbcdc1b6fda7fa8f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.807265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641888d7015b4151bbcdc1b6fda7fa8f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.830072 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:06.868653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979f04d-3caf-4cb1-8a1e-cb0ef04d0e0a admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:06.873303 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:06.873878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:06.874161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:06.874431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] PATH_INFO: `/v3/users/7230e0938f914a8fbe2c253072766d37` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:06.875571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7230e0938f914a8fbe2c253072766d37)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:06.877460 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:06.885893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641888d7015b4151bbcdc1b6fda7fa8f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:06.900959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1403/2779] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:06 2022] DELETE /identity/v3/users/641888d7015b4151bbcdc1b6fda7fa8f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:07.100771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7230e0938f914a8fbe2c253072766d37'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.101439 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7230e0938f914a8fbe2c253072766d37'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.177927 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7230e0938f914a8fbe2c253072766d37'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.190951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7230e0938f914a8fbe2c253072766d37'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.198636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7230e0938f914a8fbe2c253072766d37'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.204761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1377/2780] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:06 2022] DELETE /identity/v3/users/7230e0938f914a8fbe2c253072766d37 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:07.322178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:07.326576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:07.403936 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6311a9-90cd-42eb-becd-79fb18dacc30 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:07.459302 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:07.459934 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:07.460333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:07.460609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] PATH_INFO: `/v3/projects/4c6b3d37875d49b98225d8f72a41def2` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:07.461767 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6b3d37875d49b98225d8f72a41def2)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:07.463709 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:07.474506 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:07.584845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6b3d37875d49b98225d8f72a41def2', 'request_id': 'req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.691878 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6b3d37875d49b98225d8f72a41def2', 'request_id': 'req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.698982 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6b3d37875d49b98225d8f72a41def2', 'request_id': 'req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.710399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] The token cache is being invalidate because project 4c6b3d37875d49b98225d8f72a41def2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:07.711326 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.711974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:07.713524 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1404/2781] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:07 2022] DELETE /identity/v3/projects/4c6b3d37875d49b98225d8f72a41def2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:07.717527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:07.719071 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:07.758206 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5c20-ed1f-40a1-95e4-9a0412b82907 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:07.764886 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:07.766301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:07.848349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:07.874951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:07.875623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:07.875899 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:07.876170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] PATH_INFO: `/v3/users/31c74891a5024ca48454d2af960e3cb8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:07.877447 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c74891a5024ca48454d2af960e3cb8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:07.880136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.025174 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ccf08-c8a4-46c8-bad9-7e315d772b0f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.029915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.030645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.030928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.031204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] PATH_INFO: `/v3/projects/50e1f4034607496786f747c54db63544` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.032338 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e1f4034607496786f747c54db63544)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.034299 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.037913 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c74891a5024ca48454d2af960e3cb8'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.038603 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c74891a5024ca48454d2af960e3cb8'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.115481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c74891a5024ca48454d2af960e3cb8'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.127957 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c74891a5024ca48454d2af960e3cb8'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.135155 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-ff7d153e-5720-44df-85ea-e9e907412481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c74891a5024ca48454d2af960e3cb8'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.141424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1378/2782] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:07 2022] DELETE /identity/v3/users/31c74891a5024ca48454d2af960e3cb8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:08.155425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:08.156777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e1f4034607496786f747c54db63544', 'request_id': 'req-d9882927-69f4-4559-b1c5-7e02d6500247'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.251698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e1f4034607496786f747c54db63544', 'request_id': 'req-d9882927-69f4-4559-b1c5-7e02d6500247'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.258427 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e1f4034607496786f747c54db63544', 'request_id': 'req-d9882927-69f4-4559-b1c5-7e02d6500247'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.268808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] The token cache is being invalidate because project 50e1f4034607496786f747c54db63544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:08.269097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.270236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-d9882927-69f4-4559-b1c5-7e02d6500247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.271739 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1405/2783] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:07 2022] DELETE /identity/v3/projects/50e1f4034607496786f747c54db63544 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:08.276707 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.276936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.277243 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.335976 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:08.337887 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:08.412287 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1379/2784] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:08.413443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.413931 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.414132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.434305 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:08.435553 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:08.444312 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1406/2785] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:08.448418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.459143 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7ee3b-7c8f-4ccc-b6f7-d8087e061f30 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.464212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.464823 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.465106 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.465380 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.466033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:08.466339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.468112 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.481445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1380/2786] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:04:08.485972 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.496700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa2b9-5f5b-47c5-be4c-50afb15bd540 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.501409 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.502059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.502342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.502648 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.503291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.505540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.626519 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.628916 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1407/2787] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:08 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:08.629579 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:08.630586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.645686 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd6a7-e90b-4e93-bde8-76c3b7021121 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.660791 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:08.698843 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494387f-c364-4388-b4b2-281c705bb11b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.703666 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.704268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.704547 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.704817 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.705443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.708228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.712666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.712666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.712666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.712666 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] PATH_INFO: `/v3/projects/04649ac944554231ad6fd9c3991580e8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.713683 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04649ac944554231ad6fd9c3991580e8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.715740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.847097 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1408/2788] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:08 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:08.851199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.861538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4213af-4261-4f7e-a835-eed08dd0b6ac admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.861940 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04649ac944554231ad6fd9c3991580e8', 'request_id': 'req-551be2ba-4480-4021-a433-15ac1af77e26'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.920151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.920682 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.920963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.921234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.921898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.923554 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.933228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1409/2789] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:08.937063 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.947286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619fe6-cc4d-437f-9f74-4935f8124adb admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.951747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.952318 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.952599 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.952873 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.953595 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:08.955178 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:08.965601 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1410/2790] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:04:08.966270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04649ac944554231ad6fd9c3991580e8', 'request_id': 'req-551be2ba-4480-4021-a433-15ac1af77e26'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.970126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:08.974400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04649ac944554231ad6fd9c3991580e8', 'request_id': 'req-551be2ba-4480-4021-a433-15ac1af77e26'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.980698 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3173-ace0-4742-99e9-4f086e29e87b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:08.984638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] The token cache is being invalidate because project 04649ac944554231ad6fd9c3991580e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:08.984933 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.985477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:08.985626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-551be2ba-4480-4021-a433-15ac1af77e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:08.986387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:08.986703 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:08.986978 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] PATH_INFO: `/v3/projects/fb743be113b34cbba0d964efb9d72225/users/bcf214a89e0447608b4cba1f4b250057/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:08.987183 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1381/2791] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:08 2022] DELETE /identity/v3/projects/04649ac944554231ad6fd9c3991580e8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:09.005775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb743be113b34cbba0d964efb9d72225, user_id=bcf214a89e0447608b4cba1f4b250057, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.008925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.093429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:09.099850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1411/2792] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:08 2022] PUT /identity/v3/projects/fb743be113b34cbba0d964efb9d72225/users/bcf214a89e0447608b4cba1f4b250057/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:09.112044 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.112334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.112616 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.143904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] MFA Rules not processed for user `bcf214a89e0447608b4cba1f4b250057`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:09.145358 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:09.217797 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1382/2793] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:09.222267 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.224039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:09.289540 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf8cf-31e3-4c93-b419-0b7638f69803 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.294265 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.294898 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.295180 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.295457 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.296099 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.297976 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.367970 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1412/2794] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:09 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:09.372039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.383551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27858a5-8f00-42f4-a0fe-0edefcd64300 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.416981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:09.440475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.441082 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.441361 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.441659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.442299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.444259 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.543266 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1383/2795] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:09 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:09.547243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.559268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5e8e5-fc1d-473c-8f69-7f4db779dec0 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.564243 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.564905 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.565184 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.565456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.566205 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.568056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.578170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1413/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:09.582455 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.592582 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca24bb-9431-4edd-9b51-bf6f165ec7fa admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.597192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.598354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.599056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.599056 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] PATH_INFO: `/v3/projects/b7da8a0fc6db443a81c95d163642db26/users/f7f0a502b0e04167acb1ce45c9e3aac4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.613344 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7da8a0fc6db443a81c95d163642db26, user_id=f7f0a502b0e04167acb1ce45c9e3aac4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.616672 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.674595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1384/2797] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:09 2022] PUT /identity/v3/projects/b7da8a0fc6db443a81c95d163642db26/users/f7f0a502b0e04167acb1ce45c9e3aac4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:09.679609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.691064 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1144b7-54c5-4abb-9664-b2aadb9371e5 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.746834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.747441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.747723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.747993 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.748632 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.750216 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142076b-0d84-42df-9881-ff9be78d4a71 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.759850 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1414/2798] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:09.764013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.775346 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75875472-617c-4c98-9be0-d2d4b06fc70d admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.780263 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.780912 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.781274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.781500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] PATH_INFO: `/v3/projects/b7da8a0fc6db443a81c95d163642db26/users/f7f0a502b0e04167acb1ce45c9e3aac4/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.783467 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7da8a0fc6db443a81c95d163642db26, user_id=f7f0a502b0e04167acb1ce45c9e3aac4, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:09.786728 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:09.796909 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1385/2799] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:09 2022] PUT /identity/v3/projects/b7da8a0fc6db443a81c95d163642db26/users/f7f0a502b0e04167acb1ce45c9e3aac4/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:09.806845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.807128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.807400 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:09.835420 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] MFA Rules not processed for user `f7f0a502b0e04167acb1ce45c9e3aac4`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:09.836621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:09.894052 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:09.904716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1415/2800] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:09.916437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:09.918220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:09.991958 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307f961-3430-4602-9720-1a8a573e5672 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:09.995591 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:09.996189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:09.996471 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:09.996744 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:10.005699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:10.007140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:10.016639 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1386/2801] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:10.149373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:10.150818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:10.162944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff7c9-f13e-4eab-952e-d66a38861f85 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:10.166477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:10.167086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:10.167377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:10.167652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:10.224262 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:10.225691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f43fe-a10c-4695-bda7-7bc487e70ce6 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:10.234552 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1416/2802] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:15.010766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:15.077367 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dcb14-213b-402d-ba74-182f19b10a01 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:15.082563 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:15.083217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:15.083503 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:15.083772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] PATH_INFO: `/v3/users/bcf214a89e0447608b4cba1f4b250057` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:15.085760 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf214a89e0447608b4cba1f4b250057)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:15.088778 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:15.107284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:15.301700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf214a89e0447608b4cba1f4b250057'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:15.302400 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf214a89e0447608b4cba1f4b250057'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:15.377793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf214a89e0447608b4cba1f4b250057'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:15.391437 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf214a89e0447608b4cba1f4b250057'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:15.398220 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf214a89e0447608b4cba1f4b250057'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:15.404230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1387/2803] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:15 2022] DELETE /identity/v3/users/bcf214a89e0447608b4cba1f4b250057 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:15.408828 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:15.409329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:15.409435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:15.430741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:15.431984 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:15.489914 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1417/2804] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:15.500450 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:15.502401 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:15.561595 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dff961-69b1-4391-8c0a-61c7e68a4c02 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:15.565059 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:15.565664 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:15.565942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:15.566209 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:15.575962 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:15.577374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:15.586900 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1388/2805] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:16.087329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:16.087329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:16.106044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7437-838a-4192-90a7-fea78292c3bc None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:16.111508 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:16.112285 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:16.113391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:16.114157 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] PATH_INFO: `/v3/projects/fb743be113b34cbba0d964efb9d72225` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:16.116658 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb743be113b34cbba0d964efb9d72225)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:16.120224 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:16.246584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb743be113b34cbba0d964efb9d72225', 'request_id': 'req-66699de3-ea7c-435d-87b3-8546dbf7990d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.320214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb743be113b34cbba0d964efb9d72225', 'request_id': 'req-66699de3-ea7c-435d-87b3-8546dbf7990d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.326644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb743be113b34cbba0d964efb9d72225', 'request_id': 'req-66699de3-ea7c-435d-87b3-8546dbf7990d'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.337497 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] The token cache is being invalidate because project fb743be113b34cbba0d964efb9d72225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:16.337724 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.338342 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.339818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1418/2806] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:16 2022] DELETE /identity/v3/projects/fb743be113b34cbba0d964efb9d72225 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:16.343816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:16.354858 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85c16-93a6-4d90-a341-5408efbe2a50 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:16.411577 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:16.412212 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:16.412496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:16.412771 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] PATH_INFO: `/v3/users/f7f0a502b0e04167acb1ce45c9e3aac4` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:16.413961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f0a502b0e04167acb1ce45c9e3aac4)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:16.416879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:16.637813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:16.643742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f0a502b0e04167acb1ce45c9e3aac4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.644389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f0a502b0e04167acb1ce45c9e3aac4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.760949 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f0a502b0e04167acb1ce45c9e3aac4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.774021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f0a502b0e04167acb1ce45c9e3aac4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.784170 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28563b0c-6bf1-4641-86bd-820c765437a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f0a502b0e04167acb1ce45c9e3aac4'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:16.791956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1389/2807] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:16 2022] DELETE /identity/v3/users/f7f0a502b0e04167acb1ce45c9e3aac4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:17.174291 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.175748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:17.191233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66699de3-ea7c-435d-87b3-8546dbf7990d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.203636 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:17.249062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.249690 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.249968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.250238 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] PATH_INFO: `/v3/projects/b7da8a0fc6db443a81c95d163642db26` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.251384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7da8a0fc6db443a81c95d163642db26)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.253257 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.343373 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7da8a0fc6db443a81c95d163642db26', 'request_id': 'req-2320f567-ced7-482f-9db0-c7be9524f62f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:17.389149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7da8a0fc6db443a81c95d163642db26', 'request_id': 'req-2320f567-ced7-482f-9db0-c7be9524f62f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:17.395998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7da8a0fc6db443a81c95d163642db26', 'request_id': 'req-2320f567-ced7-482f-9db0-c7be9524f62f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:17.407202 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] The token cache is being invalidate because project b7da8a0fc6db443a81c95d163642db26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:17.407492 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:17.408131 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-2320f567-ced7-482f-9db0-c7be9524f62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:17.409649 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1419/2808] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:17 2022] DELETE /identity/v3/projects/b7da8a0fc6db443a81c95d163642db26 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:17.414754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.415818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.415969 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.436063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:17.437248 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:17.496168 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1390/2809] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:17.503965 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.504258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.504538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.525349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:17.526600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:17.534362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1420/2810] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:17.538608 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.548754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befab625-cf68-4bf7-8717-a1e139e19f09 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.553339 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.553938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.554221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.554525 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.555173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:17.561453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.561453 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.569146 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1391/2811] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:17.573434 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.583065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b7b48-1dc7-4377-ab93-3352113a1905 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.588621 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.589214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.589493 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.589765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.590404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.592321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.670161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1421/2812] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:17 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:17.674386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.684692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909ee70-d24b-431c-86be-4024a48fcd8b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.741897 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.742542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.742853 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.743127 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.744311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.746265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.841653 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1392/2813] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:17 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:17.845884 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.857290 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feea668-7c6c-4e70-8c52-1d66ec85dc7a admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.861909 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.862550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.862839 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.863115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.863764 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.865351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.875377 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1422/2814] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:17.879507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.889721 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458b1c-573b-4c97-90a3-235294af7258 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.894610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.895221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.895498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.895766 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.896431 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.898050 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca2c-0908-4c03-8ac2-d0ad9d97e823 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:17.909204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1393/2815] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:17.913233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:17.923928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee346-9c6e-4de3-9cdb-d0489a26c090 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:17.928629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:17.929269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:17.929548 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:17.929818 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] PATH_INFO: `/v3/projects/c23a8b4859104988aa69b0e2d7bc979c/users/768dfc64dafc496d8e910433ffbed9c5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:17.944149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23a8b4859104988aa69b0e2d7bc979c, user_id=768dfc64dafc496d8e910433ffbed9c5, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:17.947500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.006401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1423/2816] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:17 2022] PUT /identity/v3/projects/c23a8b4859104988aa69b0e2d7bc979c/users/768dfc64dafc496d8e910433ffbed9c5/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:18.018407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.018800 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.019062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.047108 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] MFA Rules not processed for user `768dfc64dafc496d8e910433ffbed9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:18.048333 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:18.057403 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:18.112874 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1394/2817] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:18.117425 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.163368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:18.180065 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404db76-50b9-43d7-962d-49dc0de3d660 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.185644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.186348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.186821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.187132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.187765 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.189691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.276912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1424/2818] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:18.281032 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.291654 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59382c73-5f63-4933-bfb4-19290b426753 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.348950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.349566 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.349857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.350134 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.350817 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.352786 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.453454 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1395/2819] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:18 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:18.457816 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.473044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e543-5edb-4e43-918d-c24aa9da41ea admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.478691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.479317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.479605 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.480015 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.480674 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.482301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.495687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1425/2820] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:18.500046 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.510828 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1abb6-90e6-4438-abad-9a52aa2ac9de admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.515658 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.516308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.516587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.516859 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] PATH_INFO: `/v3/projects/b1ad87538b554f4bb0f063c4be576732/users/889456c397e047e7a3e690197766973c/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.532960 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ad87538b554f4bb0f063c4be576732, user_id=889456c397e047e7a3e690197766973c, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.535549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.630369 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1396/2821] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:18 2022] PUT /identity/v3/projects/b1ad87538b554f4bb0f063c4be576732/users/889456c397e047e7a3e690197766973c/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:18.635130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.645391 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af84f43-e7aa-4613-a67a-0c64b963fc7d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.702912 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.703526 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.703810 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.704083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.704727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.706313 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5876b8-570f-4e10-a9cb-f8e99fd62818 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.716428 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1426/2822] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:18.720407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.732501 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1110-98ec-44c0-adc1-b186cefcb50b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.737300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.737970 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.738252 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.738554 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] PATH_INFO: `/v3/projects/b1ad87538b554f4bb0f063c4be576732/users/889456c397e047e7a3e690197766973c/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.740508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ad87538b554f4bb0f063c4be576732, user_id=889456c397e047e7a3e690197766973c, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.743274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.756013 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1397/2823] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:18 2022] PUT /identity/v3/projects/b1ad87538b554f4bb0f063c4be576732/users/889456c397e047e7a3e690197766973c/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:18.767691 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb149-3be2-4559-b413-20d01382e005 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.767990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb149-3be2-4559-b413-20d01382e005 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.769221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb149-3be2-4559-b413-20d01382e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.797124 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-836bb149-3be2-4559-b413-20d01382e005 None None] MFA Rules not processed for user `889456c397e047e7a3e690197766973c`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:18.798321 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-836bb149-3be2-4559-b413-20d01382e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:18.876464 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1427/2824] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:18.888973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:18.891140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:18.952441 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9aa0b-e86a-45b7-9a1d-5c895d901da7 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:18.955974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:18.956574 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:18.956857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:18.957131 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:18.966763 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:18.968201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:18.978363 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1398/2825] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:19.801911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb149-3be2-4559-b413-20d01382e005 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:19.812732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb149-3be2-4559-b413-20d01382e005 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:19.817585 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889456c397e047e7a3e690197766973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ad87538b554f4bb0f063c4be576732', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:19.818233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:19.818560 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:19.818847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:19.819511 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:19.819822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:19.822143 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:19.834053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1428/2826] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:19.838489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:19.847942 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ace75-1cae-42dc-839b-e996b6fa0176 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:19.852284 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889456c397e047e7a3e690197766973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ad87538b554f4bb0f063c4be576732', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:19.853037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:19.853323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:19.853598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:19.854235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:19.856161 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:19.860555 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:19.940270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1399/2827] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:19 2022] POST /identity/v3/projects => generated 354 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:19.944700 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:19.955489 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3599-7ba5-47ed-8143-b88e513c6b3b tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:19.975310 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:20.011031 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889456c397e047e7a3e690197766973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ad87538b554f4bb0f063c4be576732', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:20.011573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:20.011857 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:20.012133 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:20.012780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:20.013086 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:20.014699 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:20.026059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1429/2828] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:20.063617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:20.074635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077086-05a0-4513-aa02-5c285567cbad tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:20.079132 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889456c397e047e7a3e690197766973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ad87538b554f4bb0f063c4be576732', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:20.079746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:20.080033 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:20.080305 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] PATH_INFO: `/v3/projects/427c0943147a4a19ad61ee8a70136ed4` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:20.081416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorizing `identity:delete_project(project_id=427c0943147a4a19ad61ee8a70136ed4)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:20.083355 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:20.185031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427c0943147a4a19ad61ee8a70136ed4', 'request_id': 'req-dbf28df3-b63d-4127-850d-b330fd3f6e5d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:20.252031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427c0943147a4a19ad61ee8a70136ed4', 'request_id': 'req-dbf28df3-b63d-4127-850d-b330fd3f6e5d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:20.258629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427c0943147a4a19ad61ee8a70136ed4', 'request_id': 'req-dbf28df3-b63d-4127-850d-b330fd3f6e5d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:20.269307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] The token cache is being invalidate because project 427c0943147a4a19ad61ee8a70136ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:20.269544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:20.270190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-dbf28df3-b63d-4127-850d-b330fd3f6e5d tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:20.271737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1400/2829] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:20 2022] DELETE /identity/v3/projects/427c0943147a4a19ad61ee8a70136ed4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:20.787861 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:20.789620 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:20.855329 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cdffe-1b6b-4b25-ab98-eccf242ea3a3 tempest-VolumeQuotaClassesTest-138526112 tempest-VolumeQuotaClassesTest-138526112-project-admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:20.909369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:20.909998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:20.910282 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:20.910590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] PATH_INFO: `/v3/users/768dfc64dafc496d8e910433ffbed9c5` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:20.911727 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768dfc64dafc496d8e910433ffbed9c5)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:20.913628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:21.065094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768dfc64dafc496d8e910433ffbed9c5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.077650 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768dfc64dafc496d8e910433ffbed9c5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.078311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768dfc64dafc496d8e910433ffbed9c5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.078937 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768dfc64dafc496d8e910433ffbed9c5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.081461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:21.149182 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768dfc64dafc496d8e910433ffbed9c5'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.163836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1430/2830] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:20 2022] DELETE /identity/v3/users/768dfc64dafc496d8e910433ffbed9c5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:21.168415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:21.168922 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:21.169022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:21.187629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:21.188832 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:21.246451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1401/2831] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:21.256244 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:21.257624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:21.313735 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48ba6-b0ef-40a3-8a76-8b81aaa55c38 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:21.317374 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:21.317907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:21.318188 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:21.318478 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:21.328070 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:21.329477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:21.338956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1431/2832] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:21.651307 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:21.652685 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:21.723002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:21.747223 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712587a-3383-4722-9129-c47fcf5904c3 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:21.752192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:21.752803 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:21.753200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:21.753436 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:21.755201 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:21.767784 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:21.769364 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:21.779679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1402/2833] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:21.792029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:21.794706 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:21.809613 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80e5f-51ad-412f-aaee-35c959ce85d5 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:21.819304 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:21.819957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:21.820245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:21.820520 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] PATH_INFO: `/v3/projects/c23a8b4859104988aa69b0e2d7bc979c` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:21.821769 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23a8b4859104988aa69b0e2d7bc979c)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:21.824399 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:21.934845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23a8b4859104988aa69b0e2d7bc979c', 'request_id': 'req-06a69c04-0935-4d72-a6ca-99eb0bf17f31'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.983550 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23a8b4859104988aa69b0e2d7bc979c', 'request_id': 'req-06a69c04-0935-4d72-a6ca-99eb0bf17f31'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:21.990822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23a8b4859104988aa69b0e2d7bc979c', 'request_id': 'req-06a69c04-0935-4d72-a6ca-99eb0bf17f31'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.002225 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] The token cache is being invalidate because project c23a8b4859104988aa69b0e2d7bc979c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:22.002542 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.003472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.004945 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1432/2834] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:21 2022] DELETE /identity/v3/projects/c23a8b4859104988aa69b0e2d7bc979c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:22.009174 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:22.020147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8661953-fa58-44da-83e8-807cd1db6a17 service placement] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:22.077253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:22.077905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:22.078189 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:22.078488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] PATH_INFO: `/v3/users/889456c397e047e7a3e690197766973c` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:22.079689 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889456c397e047e7a3e690197766973c)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:22.081597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:22.220387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889456c397e047e7a3e690197766973c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.221025 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889456c397e047e7a3e690197766973c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.286001 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889456c397e047e7a3e690197766973c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.299308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889456c397e047e7a3e690197766973c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.307185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-6b301f0b-9e56-4794-a128-8456300b9eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889456c397e047e7a3e690197766973c'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.313448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1403/2835] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:22 2022] DELETE /identity/v3/users/889456c397e047e7a3e690197766973c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:22.721959 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:22.723534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:22.737332 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c04-0935-4d72-a6ca-99eb0bf17f31 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:22.796080 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:22.796635 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:22.796911 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:22.797181 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] PATH_INFO: `/v3/projects/b1ad87538b554f4bb0f063c4be576732` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:22.798275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ad87538b554f4bb0f063c4be576732)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:22.800266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:22.812743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:22.881380 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ad87538b554f4bb0f063c4be576732', 'request_id': 'req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.960781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ad87538b554f4bb0f063c4be576732', 'request_id': 'req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.967992 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ad87538b554f4bb0f063c4be576732', 'request_id': 'req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.979163 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] The token cache is being invalidate because project b1ad87538b554f4bb0f063c4be576732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:22.979563 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.980215 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7ea721ff-b4a3-4ae2-9bdd-6759b99a29de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:22.981907 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1433/2836] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:22 2022] DELETE /identity/v3/projects/b1ad87538b554f4bb0f063c4be576732 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:22.986655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:22.986973 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:22.989448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.006868 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:23.008074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:23.058148 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:23.067216 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1404/2837] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:23.075151 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.075441 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.075717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.095569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:23.096775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:23.105348 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1434/2838] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:23.109598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.119389 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7ddd-bb3f-4d33-832c-b895fe30bab7 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.124489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.125087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.125365 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.125635 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.126270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:23.126599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.128230 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.139567 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1405/2839] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:23.144025 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.153687 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93b58-72c0-46e1-b8e0-f928fee6b984 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.158228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.158856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.159135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.159403 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.160026 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.161897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.247995 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1435/2840] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:23.252149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.262840 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8cb8-350e-47ed-8df0-ac8a62c3d05e admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.318881 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.319417 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.319700 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.319972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.320612 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.323094 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.400951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1406/2841] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:23.405837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.416504 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be35-db18-458c-9f87-24ea1c4211bc admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.421226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.421820 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.422101 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.422372 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.423214 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.424792 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.435206 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1436/2842] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:23.439104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.449583 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147bd4-32a7-4a2a-a848-3bee31a346ba admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.454402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.455114 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.455392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.455687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.456354 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.457937 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699317f-2390-4378-8bad-f719a5a578ab admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.469516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1407/2843] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:04:23.473752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.484439 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7378f-7547-4022-8151-0f1d9ab30984 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.488957 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.489598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.489924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.490192 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] PATH_INFO: `/v3/projects/03234597eae941909359f915ec9c4117/users/a12adac1ccb940fda1849309882b1e9b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.504331 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03234597eae941909359f915ec9c4117, user_id=a12adac1ccb940fda1849309882b1e9b, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.506974 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.578906 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1437/2844] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:23 2022] PUT /identity/v3/projects/03234597eae941909359f915ec9c4117/users/a12adac1ccb940fda1849309882b1e9b/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:23.589981 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.590270 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.590598 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.618122 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] MFA Rules not processed for user `a12adac1ccb940fda1849309882b1e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:23.620118 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:23.684350 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1408/2845] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:23.688833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.749221 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5080-93bd-4f24-9482-1bb8667f3b65 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.753751 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.754351 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.754671 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.754944 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.755574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.757582 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.842771 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1438/2846] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:23.846801 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.857282 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaeb3f-dfe0-4149-a551-c94454db9a53 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.905036 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:23.913614 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.914221 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.919538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.919538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.919538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.919538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.006260 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1409/2847] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:24.010256 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.020759 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2f914-ed4f-4d2f-b072-f181a11841fe admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.025421 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.026087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.026368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.026667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.028490 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.028874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.039122 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1439/2848] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:24.043846 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.054007 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb197676-2adb-4dd8-8d9e-177f6dcc2ce2 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.059334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.060016 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.062964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.062964 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] PATH_INFO: `/v3/projects/ea010ff40e8743029dd187ef455f19ca/users/ca90a0d62ebb4df1a2b2470d6e156ab7/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.075316 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea010ff40e8743029dd187ef455f19ca, user_id=ca90a0d62ebb4df1a2b2470d6e156ab7, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.078070 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.155496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1410/2849] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:24 2022] PUT /identity/v3/projects/ea010ff40e8743029dd187ef455f19ca/users/ca90a0d62ebb4df1a2b2470d6e156ab7/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:24.159480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.170346 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e514-781e-490f-a250-03db3a5c37df admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.178220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:24.226388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.227049 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.227330 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.227602 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.228240 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.229961 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc093f8-ee05-4d73-8844-c0ce7c6605f3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.239836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1440/2850] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:24.244109 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.254967 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0505c-28e8-4a76-a9ef-38e96686bf55 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.259556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.261198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.261480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.261753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] PATH_INFO: `/v3/projects/ea010ff40e8743029dd187ef455f19ca/users/ca90a0d62ebb4df1a2b2470d6e156ab7/roles/ce01c317402a4f3f8390b3b25aec6ea8` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.263652 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea010ff40e8743029dd187ef455f19ca, user_id=ca90a0d62ebb4df1a2b2470d6e156ab7, role_id=ce01c317402a4f3f8390b3b25aec6ea8)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.266606 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.277507 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1411/2851] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:24 2022] PUT /identity/v3/projects/ea010ff40e8743029dd187ef455f19ca/users/ca90a0d62ebb4df1a2b2470d6e156ab7/roles/ce01c317402a4f3f8390b3b25aec6ea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:24.287781 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.288160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.288472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.316248 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] MFA Rules not processed for user `ca90a0d62ebb4df1a2b2470d6e156ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:24.317449 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:24.382812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1441/2852] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:24.394772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.396418 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:24.453172 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96ef88-4642-4f0d-92ea-ef92be881e59 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.456713 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.457309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.457589 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.457856 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.466538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.467950 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.477097 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1412/2853] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:24.701387 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.710910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315f39-e727-4ef4-9f2c-7dbfecc69bbe None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.714500 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.715092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.715371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.715644 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.771473 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.772954 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69d219-b5a2-464e-9f40-60da25309ce8 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.782082 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1442/2854] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:30.897075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.961494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23c7-eb3f-4120-835a-eab21be284c5 service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.965919 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.966571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.966851 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.967140 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] PATH_INFO: `/v3/users/a12adac1ccb940fda1849309882b1e9b` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.968247 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12adac1ccb940fda1849309882b1e9b)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.970125 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.116779 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12adac1ccb940fda1849309882b1e9b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.117421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12adac1ccb940fda1849309882b1e9b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.119905 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:31.217902 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12adac1ccb940fda1849309882b1e9b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.230093 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12adac1ccb940fda1849309882b1e9b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.237022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12adac1ccb940fda1849309882b1e9b'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.242903 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1413/2855] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:30 2022] DELETE /identity/v3/users/a12adac1ccb940fda1849309882b1e9b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:31.247459 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.247929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.249938 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.269164 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:31.270369 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.296747 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=100 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:31.331286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1443/2856] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:31.341103 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:31.342609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.420087 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2147-82ce-4968-840b-569845612aff admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:31.424383 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:31.424986 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.425296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.425571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.434402 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:31.435878 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.445825 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1414/2857] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:31.832303 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:31.833865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.847040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a712-416f-4430-81d1-8b7c8611970f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:31.851678 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:31.852317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.852600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.852874 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] PATH_INFO: `/v3/projects/03234597eae941909359f915ec9c4117` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.853997 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03234597eae941909359f915ec9c4117)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:31.855955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.938523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03234597eae941909359f915ec9c4117', 'request_id': 'req-c70fb662-746b-44ca-aeb6-d0546277c76f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.989660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03234597eae941909359f915ec9c4117', 'request_id': 'req-c70fb662-746b-44ca-aeb6-d0546277c76f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.996362 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03234597eae941909359f915ec9c4117', 'request_id': 'req-c70fb662-746b-44ca-aeb6-d0546277c76f'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.006732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] The token cache is being invalidate because project 03234597eae941909359f915ec9c4117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:32.007029 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.007667 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.009130 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1444/2858] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:31 2022] DELETE /identity/v3/projects/03234597eae941909359f915ec9c4117 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:32.013253 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.023124 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c5120-b97d-47d7-80f4-1b6b65017bf6 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.079481 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.080038 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.080314 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.080580 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] PATH_INFO: `/v3/users/ca90a0d62ebb4df1a2b2470d6e156ab7` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.081706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca90a0d62ebb4df1a2b2470d6e156ab7)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.083637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.232187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca90a0d62ebb4df1a2b2470d6e156ab7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.232890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca90a0d62ebb4df1a2b2470d6e156ab7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.236562 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:32.292205 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca90a0d62ebb4df1a2b2470d6e156ab7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.304541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca90a0d62ebb4df1a2b2470d6e156ab7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.311388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d75cb55d-f27f-4918-b6d9-3c63c7aa9730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca90a0d62ebb4df1a2b2470d6e156ab7'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.317200 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1415/2859] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:32 2022] DELETE /identity/v3/users/ca90a0d62ebb4df1a2b2470d6e156ab7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:32.728755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.730228 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:32.746360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fb662-746b-44ca-aeb6-d0546277c76f admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.806059 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.807309 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.807590 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.807856 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] PATH_INFO: `/v3/projects/ea010ff40e8743029dd187ef455f19ca` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.809057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea010ff40e8743029dd187ef455f19ca)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.811068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.014808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea010ff40e8743029dd187ef455f19ca', 'request_id': 'req-211cba6a-5175-4033-a7d4-0ede40a650aa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.075190 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea010ff40e8743029dd187ef455f19ca', 'request_id': 'req-211cba6a-5175-4033-a7d4-0ede40a650aa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.076588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:33.082930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea010ff40e8743029dd187ef455f19ca', 'request_id': 'req-211cba6a-5175-4033-a7d4-0ede40a650aa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.093521 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] The token cache is being invalidate because project ea010ff40e8743029dd187ef455f19ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:33.094311 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.094534 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-211cba6a-5175-4033-a7d4-0ede40a650aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.096022 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1445/2860] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:32 2022] DELETE /identity/v3/projects/ea010ff40e8743029dd187ef455f19ca => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:33.101074 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.101597 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.101701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.122328 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:33.123599 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.183031 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1416/2861] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:33.246752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.247095 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.247382 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.267344 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:33.268483 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.276349 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1446/2862] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:33.281063 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.290929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9a37-4aeb-4b11-838b-37eb0654f678 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.295388 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.296550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.296809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.297078 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.297718 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:33.298019 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.299623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.310995 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1417/2863] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:33.315300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.324819 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e205db-c418-4fdc-970f-332983ddd72c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.330160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.330808 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.331096 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.331371 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.332018 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.333913 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.412922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1447/2864] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:33.414486 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.425489 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40f2-c3b6-4a07-a0e9-934cb434a85b admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.487128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.487871 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.488210 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.488505 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.489157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.491126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.567631 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1418/2865] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:33.572132 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.583471 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15b348-acf4-449f-b0ee-9d7552099a94 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.588479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.589081 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.589360 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.589630 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.590301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.592046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.603405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1448/2866] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:33.607627 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.618516 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b28dd4-2682-44ca-a226-3185d8d38c38 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.623139 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.623795 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.624723 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.625022 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.625741 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.627386 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdec073-bf03-44ad-84c8-599dfe600d3b admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.638240 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1419/2867] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:33.643033 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.653388 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c19e-7b58-486c-80c3-a9b05798fd8b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.658159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.658915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.659201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.659477 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] PATH_INFO: `/v3/projects/b52bf8cc74b540e2b304680a71cfbfc4/users/3c1e4809515b495d9b97539868aad3ca/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.674869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52bf8cc74b540e2b304680a71cfbfc4, user_id=3c1e4809515b495d9b97539868aad3ca, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.677519 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.739301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1449/2868] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:33 2022] PUT /identity/v3/projects/b52bf8cc74b540e2b304680a71cfbfc4/users/3c1e4809515b495d9b97539868aad3ca/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:33.750196 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.751541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.751541 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.778761 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] MFA Rules not processed for user `3c1e4809515b495d9b97539868aad3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:33.780428 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.806527 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:33.854735 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1420/2869] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:33.867039 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.868722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.956274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7401dd-aef8-49c6-a414-87a4ae264c34 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.959929 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.960532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.960812 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.961170 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.970541 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.971963 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a810-a219-47f1-8702-7a0fdff07833 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.980868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1450/2870] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:34.003724 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.070809 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a911ce-48b3-4848-9e41-8c9e52868183 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.075539 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.076166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.076445 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.076714 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] PATH_INFO: `/v3/users/3c1e4809515b495d9b97539868aad3ca` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.078029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1e4809515b495d9b97539868aad3ca)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.079968 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.239135 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1e4809515b495d9b97539868aad3ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.239740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1e4809515b495d9b97539868aad3ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.344993 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1e4809515b495d9b97539868aad3ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.361392 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1e4809515b495d9b97539868aad3ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.369772 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1e4809515b495d9b97539868aad3ca'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.376610 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1421/2871] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:34 2022] DELETE /identity/v3/users/3c1e4809515b495d9b97539868aad3ca => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:34.381278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.381732 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.382083 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.420354 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:34.422956 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.508964 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1451/2872] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:34.520394 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.521852 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.580690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:34.594300 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0289b-0b00-497a-9067-dd8d6b994470 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.598678 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.603075 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.603836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.604280 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.619381 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.621397 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f27d7-869c-46b8-910b-49a5e866c169 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.639225 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1422/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:35.116445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.116445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:35.129004 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:35.138315 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484518a-5db8-42ad-9d9d-132fef3abd9f None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.144609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.145287 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.145570 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.145869 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] PATH_INFO: `/v3/projects/b52bf8cc74b540e2b304680a71cfbfc4` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.147042 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52bf8cc74b540e2b304680a71cfbfc4)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.149062 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.237946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52bf8cc74b540e2b304680a71cfbfc4', 'request_id': 'req-271aeedc-2752-4521-ab9e-0c0f8497eaaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:35.276486 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52bf8cc74b540e2b304680a71cfbfc4', 'request_id': 'req-271aeedc-2752-4521-ab9e-0c0f8497eaaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:35.284479 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52bf8cc74b540e2b304680a71cfbfc4', 'request_id': 'req-271aeedc-2752-4521-ab9e-0c0f8497eaaa'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:35.305865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] The token cache is being invalidate because project b52bf8cc74b540e2b304680a71cfbfc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:35.305865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:35.305865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-271aeedc-2752-4521-ab9e-0c0f8497eaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:35.305865 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1452/2874] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:35 2022] DELETE /identity/v3/projects/b52bf8cc74b540e2b304680a71cfbfc4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:35.310703 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.311192 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.311317 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.332047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:35.333276 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:35.394550 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1423/2875] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:35.402258 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.402576 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.402773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.422722 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:35.423928 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:35.431761 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1453/2876] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:35.435989 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.446308 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f711ba-c35c-47e6-8ced-19e01658f62c None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.450877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.451472 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.451754 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.452659 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.453323 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:35.453621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.455219 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.466496 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1424/2877] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:04:35.470924 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.480092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3335bb-3c5d-4f9d-9a8b-868a1c59a544 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.485233 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.485834 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.486193 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.486527 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] PATH_INFO: `/v3/projects` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.487129 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.489009 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.597147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1454/2878] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:35 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:35.601542 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.611656 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992388-ce38-4921-87df-c6744b7972e4 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.669646 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.670256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.670693 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.670975 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.671717 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.673617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.796609 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1425/2879] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:35 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:35.800401 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.810775 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a239-ac43-4f6b-827d-c415a4a1a79b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.817139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.817139 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.817394 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.817609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.818269 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.819894 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.830623 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1455/2880] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:35.834733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.845190 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486d64-6e2c-442b-abba-e1005bb422c6 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.849815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.850415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.850725 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.850997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.851638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.853277 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50317b90-04f9-49f2-badf-cf8d151643b5 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:35.871877 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1426/2881] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:35.877179 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:35.895794 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046f3eb-006c-4416-9a33-cbaa973321e1 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:35.900752 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:35.901517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] REQUEST_METHOD: `PUT` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:35.902154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:35.902154 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] PATH_INFO: `/v3/projects/188b6c297be14d689e8c9709147acaf7/users/c248395540ae491daa458acf396439f7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:35.918588 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b6c297be14d689e8c9709147acaf7, user_id=c248395540ae491daa458acf396439f7, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:35.922201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:36.000745 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1456/2882] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:35 2022] PUT /identity/v3/projects/188b6c297be14d689e8c9709147acaf7/users/c248395540ae491daa458acf396439f7/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:36.005461 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a57d7-f514-4369-8164-531d8f2dd189 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:36.005996 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a57d7-f514-4369-8164-531d8f2dd189 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:36.006275 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a57d7-f514-4369-8164-531d8f2dd189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:36.042101 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-676a57d7-f514-4369-8164-531d8f2dd189 None None] MFA Rules not processed for user `c248395540ae491daa458acf396439f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:36.043487 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-676a57d7-f514-4369-8164-531d8f2dd189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:36.087637 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:36.113141 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1427/2883] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:36.126053 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:36.127807 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:36.185447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9ef8f-9ab9-4ae9-a5f3-d7b97781cfbd admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:36.189922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:36.190572 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:36.190859 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:36.191134 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:36.199897 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:36.201445 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:36.211986 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1457/2884] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:37.914029 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:37.918043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:37.918043 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:37.934629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] MFA Rules not processed for user `c248395540ae491daa458acf396439f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:37.935827 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:37.942891 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1428/2885] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:46.207624 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:47.094160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:47.095814 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:47.175811 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00176226-04f5-4182-b23d-9738e9709ad1 service cinder] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:47.180339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:47.180955 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:47.181234 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:47.181503 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] PATH_INFO: `/v3/users/3f53373c293d4766815306b616c8e241` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:47.182721 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f53373c293d4766815306b616c8e241)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:47.184628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:47.314068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f53373c293d4766815306b616c8e241'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.326300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f53373c293d4766815306b616c8e241'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.328266 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f53373c293d4766815306b616c8e241'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.328922 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f53373c293d4766815306b616c8e241'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.384555 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f53373c293d4766815306b616c8e241'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.398226 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1458/2886] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:47 2022] DELETE /identity/v3/users/3f53373c293d4766815306b616c8e241 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:47.654556 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:47.665667 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f437a7-6561-4635-9423-5cd708d34063 None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:47.724191 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:47.724816 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:47.725184 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:47.725462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] PATH_INFO: `/v3/projects/f64dacf23ef44e6db4fbddf3cf41b8e3` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:47.726692 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64dacf23ef44e6db4fbddf3cf41b8e3)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:47.728617 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:47.809086 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64dacf23ef44e6db4fbddf3cf41b8e3', 'request_id': 'req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.859936 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64dacf23ef44e6db4fbddf3cf41b8e3', 'request_id': 'req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.867037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64dacf23ef44e6db4fbddf3cf41b8e3', 'request_id': 'req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.878526 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] The token cache is being invalidate because project f64dacf23ef44e6db4fbddf3cf41b8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:47.878818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.879462 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:47.881185 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1429/2887] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:47 2022] DELETE /identity/v3/projects/f64dacf23ef44e6db4fbddf3cf41b8e3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:47.885102 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:47.886655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:47.900513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c9d9-4676-43b3-a094-a14c0bfec7f3 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:47.957204 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:47.957823 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:47.958108 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:47.958384 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] PATH_INFO: `/v3/users/1f80e91962d3474597cdb7cdb38f0283` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:47.959551 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f80e91962d3474597cdb7cdb38f0283)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:47.961487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:47.982301 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:48.193948 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f80e91962d3474597cdb7cdb38f0283'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.207334 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f80e91962d3474597cdb7cdb38f0283'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.208057 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f80e91962d3474597cdb7cdb38f0283'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.208660 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f80e91962d3474597cdb7cdb38f0283'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.282114 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-c3c5e443-d05f-4be3-b207-6065c2033170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f80e91962d3474597cdb7cdb38f0283'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.296776 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1459/2888] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:47 2022] DELETE /identity/v3/users/1f80e91962d3474597cdb7cdb38f0283 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:48.535051 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.536494 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:48.549588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121097be-61d1-4ccf-ad1b-be7b8b5b9b54 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.612710 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.613374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.619776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.619776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] PATH_INFO: `/v3/projects/b9e023c595b94d7385d3131a271f7343` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.619776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e023c595b94d7385d3131a271f7343)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.619776 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.624910 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:48.724456 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e023c595b94d7385d3131a271f7343', 'request_id': 'req-196d8974-620a-46a2-9612-56ee4f2abde9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.790572 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e023c595b94d7385d3131a271f7343', 'request_id': 'req-196d8974-620a-46a2-9612-56ee4f2abde9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.797500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e023c595b94d7385d3131a271f7343', 'request_id': 'req-196d8974-620a-46a2-9612-56ee4f2abde9'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.808655 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] The token cache is being invalidate because project b9e023c595b94d7385d3131a271f7343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:48.808983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.809602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:48.818757 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1430/2889] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:48 2022] DELETE /identity/v3/projects/b9e023c595b94d7385d3131a271f7343 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:56.686634 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816283-9d6b-4c3d-bf18-a022bd67f0b8 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:56.688028 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816283-9d6b-4c3d-bf18-a022bd67f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:56.688317 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816283-9d6b-4c3d-bf18-a022bd67f0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:56.718259 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-1e816283-9d6b-4c3d-bf18-a022bd67f0b8 None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:56.719584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-1e816283-9d6b-4c3d-bf18-a022bd67f0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:56.780068 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1460/2890] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:56.914272 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:56.915733 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:56.985026 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8974-620a-46a2-9612-56ee4f2abde9 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:56.989920 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:56.990548 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:56.990830 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:56.991104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:56.999048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:57.001294 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:57.009128 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1431/2891] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:04:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:04:57.735584 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49da04-9ad6-4865-8c20-d3e49a135dcb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:57.736056 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49da04-9ad6-4865-8c20-d3e49a135dcb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:57.736149 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49da04-9ad6-4865-8c20-d3e49a135dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:57.755629 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6e49da04-9ad6-4865-8c20-d3e49a135dcb None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:57.756788 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6e49da04-9ad6-4865-8c20-d3e49a135dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:57.763926 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1461/2892] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 15:04:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:57.776925 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:57.788508 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2662ea-2706-459c-bf02-1a488a56716b service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:57.793427 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:57.794047 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:57.794325 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:57.794632 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:57.802671 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:57.804217 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:57.812116 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1432/2893] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:04:58.428435 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a9b3-de96-40a9-b2bc-bb5e941930bb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:58.428743 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a9b3-de96-40a9-b2bc-bb5e941930bb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:58.429035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a9b3-de96-40a9-b2bc-bb5e941930bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:58.447803 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-5064a9b3-de96-40a9-b2bc-bb5e941930bb None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:58.448981 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-5064a9b3-de96-40a9-b2bc-bb5e941930bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:58.456480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1462/2894] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 30 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:58.468956 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:58.479674 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd4c29-9dbe-4b2b-b263-a50636a90fc1 service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:58.484831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:58.485424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:58.485731 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:58.486002 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:58.494048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:58.495629 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:58.503712 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1433/2895] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:04:59.131408 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080460-ed88-44a5-995c-740d365af4eb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:59.131900 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080460-ed88-44a5-995c-740d365af4eb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:59.132054 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080460-ed88-44a5-995c-740d365af4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:59.151996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-21080460-ed88-44a5-995c-740d365af4eb None None] MFA Rules not processed for user `6b75d4fa3ca04bd69c079295e3fc44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:59.153200 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-21080460-ed88-44a5-995c-740d365af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:59.160280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1463/2896] 10.222.0.47 () {58 vars in 967 bytes} [Tue Aug 30 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:59.172752 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:59.183352 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff01c2-952b-409c-ad0f-93e78de44ee4 service swift] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:59.188966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6314f7ac7e45b99d46d3e8a480150e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:59.189561 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:59.189847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:59.190121 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:59.198296 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:59.199898 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49eaee-e87c-4798-8c2c-2df4f9d3f0d2 service swift] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:59.207997 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1434/2897] 10.222.0.47 () {60 vars in 1384 bytes} [Tue Aug 30 15:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:05:01.971538 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080460-ed88-44a5-995c-740d365af4eb None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:01.972933 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-21080460-ed88-44a5-995c-740d365af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:02.038967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080460-ed88-44a5-995c-740d365af4eb None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:02.043487 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:02.044110 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:02.044397 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:02.044672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] PATH_INFO: `/v3/users/c248395540ae491daa458acf396439f7` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:02.045833 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c248395540ae491daa458acf396439f7)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:02.048147 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:02.058046 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:02.226930 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c248395540ae491daa458acf396439f7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.239115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c248395540ae491daa458acf396439f7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.239778 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c248395540ae491daa458acf396439f7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.240407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c248395540ae491daa458acf396439f7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.303780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c248395540ae491daa458acf396439f7'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.316461 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1464/2898] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:05:01 2022] DELETE /identity/v3/users/c248395540ae491daa458acf396439f7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:05:02.321126 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:02.321623 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:02.321748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:02.341010 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:02.342309 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:02.383165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:02.400571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1435/2899] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:02.410968 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:02.412411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:02.470821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87829596-ba91-429e-924d-19eb4015756d admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:02.474662 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:02.475264 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:02.475556 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:02.475836 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:02.484734 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:02.486161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5503-c4cf-4a09-8c8c-c5b2af8f7d78 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:02.495628 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1465/2900] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:02.752979 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:02.754395 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:02.767493 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b473bd-48a8-43a2-bfd4-16c709cff72a None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:02.772105 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:02.772746 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:02.773028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:02.777034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] PATH_INFO: `/v3/projects/188b6c297be14d689e8c9709147acaf7` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:02.777034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] RBAC: Authorizing `identity:delete_project(project_id=188b6c297be14d689e8c9709147acaf7)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:02.777034 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:02.905249 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188b6c297be14d689e8c9709147acaf7', 'request_id': 'req-d7714241-4c17-4b3b-b02d-e137eaa1680f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:02.996387 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188b6c297be14d689e8c9709147acaf7', 'request_id': 'req-d7714241-4c17-4b3b-b02d-e137eaa1680f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:03.003687 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188b6c297be14d689e8c9709147acaf7', 'request_id': 'req-d7714241-4c17-4b3b-b02d-e137eaa1680f'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:03.015650 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] The token cache is being invalidate because project 188b6c297be14d689e8c9709147acaf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:05:03.016028 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:03.016938 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-d7714241-4c17-4b3b-b02d-e137eaa1680f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:05:03.018756 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1436/2901] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:05:02 2022] DELETE /identity/v3/projects/188b6c297be14d689e8c9709147acaf7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:05:03.023488 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.023967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.024091 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.043813 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:03.046035 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:03.103573 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1466/2902] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:05:03.112987 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.113274 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.113544 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.133602 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:03.137831 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:03.143264 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1437/2903] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:03.147448 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.157757 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe1d8-a89e-4b71-be5d-f15bd3f3840c None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.162512 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.163121 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.163405 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.163693 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.164367 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:05:03.164651 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.166307 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.178482 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1467/2904] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 30 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:05:03.182740 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.192157 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef8f0b-546d-4078-b7f6-b6b01590f41f None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.197278 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.197893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.198173 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.198464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] PATH_INFO: `/v3/projects` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.199110 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.201004 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.301750 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1438/2905] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 30 15:05:03 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:05:03.305996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.316212 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f859-c0e7-4024-90ae-d086cdda2d7b admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.328466 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:03.372562 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.373167 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.373452 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.373729 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] PATH_INFO: `/v3/users` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.374407 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.376424 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.488910 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1468/2906] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 30 15:05:03 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:05:03.493518 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.504037 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a44e-32cb-4071-af38-f6ba64dcd131 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.508890 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.509500 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.509785 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.510062 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.510749 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.512345 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.523775 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1439/2907] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:05:03.528145 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.541107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3363f-2b29-4267-bb34-aeb866c4cc21 admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.546925 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.547719 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.548275 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.548652 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.549429 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.551655 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ade8-92c2-4414-a3f5-674882f925b6 admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.584092 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1469/2908] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:05:03.584301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.584301 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c75ef8-cfe3-4113-8f52-98f39a6dbe48 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.588701 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.589353 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] REQUEST_METHOD: `PUT` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.589638 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.589952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] PATH_INFO: `/v3/projects/fbdafec0972c47eb902191c560296a23/users/f06afa0292544e81a435a71343da8d73/roles/ad1f9d6de73c449aaa5e73d7b1d320b1` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.610136 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdafec0972c47eb902191c560296a23, user_id=f06afa0292544e81a435a71343da8d73, role_id=ad1f9d6de73c449aaa5e73d7b1d320b1)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.614622 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.757117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1440/2909] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 30 15:05:03 2022] PUT /identity/v3/projects/fbdafec0972c47eb902191c560296a23/users/f06afa0292544e81a435a71343da8d73/roles/ad1f9d6de73c449aaa5e73d7b1d320b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:05:03.762278 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a0ab3-c90b-4cb7-b815-21f94e8a5c6b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.762600 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a0ab3-c90b-4cb7-b815-21f94e8a5c6b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.762923 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a0ab3-c90b-4cb7-b815-21f94e8a5c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.783357 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c51a0ab3-c90b-4cb7-b815-21f94e8a5c6b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:03.784998 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c51a0ab3-c90b-4cb7-b815-21f94e8a5c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:03.844821 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1470/2910] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:03.854242 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:03.855961 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:03.912737 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed792c-a379-40c8-ad1f-e154b7dfc459 admin admin] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:03.916373 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:03.916983 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:03.917269 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:03.917551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:03.926838 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:03.928265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:03.938415 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1441/2911] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:05:05.117574 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6e06-723f-495c-a186-e1668b0b240d None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:05.118077 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6e06-723f-495c-a186-e1668b0b240d None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:05.118183 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6e06-723f-495c-a186-e1668b0b240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:05.147946 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-f27d6e06-723f-495c-a186-e1668b0b240d None None] MFA Rules not processed for user `f06afa0292544e81a435a71343da8d73`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:05.149199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-f27d6e06-723f-495c-a186-e1668b0b240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:05.216280 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1471/2912] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:05:05.228806 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:05.230204 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:05.241464 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:05.287258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b4c6-097b-4794-a023-ef85673da1c2 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:05.290999 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4ef96940de44a0a565e313f2ec7e8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:05.291626 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:05.291904 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:05.292215 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:05.301753 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:05.303299 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:05.313349 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1442/2913] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:07.111447 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9d48-5932-4d3b-ad09-b3702cda8346 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:07.111967 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9d48-5932-4d3b-ad09-b3702cda8346 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:07.112079 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9d48-5932-4d3b-ad09-b3702cda8346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:07.130755 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-7e9a9d48-5932-4d3b-ad09-b3702cda8346 None None] MFA Rules not processed for user `f06afa0292544e81a435a71343da8d73`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:07.131990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7e9a9d48-5932-4d3b-ad09-b3702cda8346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:07.138847 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1472/2914] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:07.375149 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:07.376719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:07.388651 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d04b-4724-4225-81d5-484dcb53ba9f service cinder] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:07.392994 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:07.393588 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:07.393873 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:07.394147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:07.395850 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:07.405166 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:07.407295 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:07.415520 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1443/2915] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:17.125363 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:17.411793 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=28 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:37.955416 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfac0-4313-416a-b592-d49f9b2515fb None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:37.956008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfac0-4313-416a-b592-d49f9b2515fb None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:37.956008 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfac0-4313-416a-b592-d49f9b2515fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:37.976078 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-22fcfac0-4313-416a-b592-d49f9b2515fb None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:37.977263 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-22fcfac0-4313-416a-b592-d49f9b2515fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:37.985782 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1473/2916] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:38.007812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:38.009258 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:38.103699 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa52c5-f6d2-4b8e-9774-bb0a3878bfd0 service neutron] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:38.109770 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:38.110371 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:38.110679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:38.110951 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:38.118892 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:38.120446 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:38.129917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1444/2917] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:44.261593 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d88c98-315e-4198-b0ba-c4f9e941dc63 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:44.262135 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d88c98-315e-4198-b0ba-c4f9e941dc63 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:44.262245 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d88c98-315e-4198-b0ba-c4f9e941dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:44.282268 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-c4d88c98-315e-4198-b0ba-c4f9e941dc63 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:44.283480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-c4d88c98-315e-4198-b0ba-c4f9e941dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:44.291222 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1474/2918] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:44.312187 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:44.313748 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:44.328235 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a291-a7ca-4a0f-ba93-0b966d9ba325 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:44.333719 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:44.334311 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:44.334619 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:44.334893 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:44.342765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:44.344857 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:44.354048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1445/2919] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:47.780480 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4543-0020-4e7d-b0b8-f5962922a98b None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:47.781044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4543-0020-4e7d-b0b8-f5962922a98b None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:47.781044 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4543-0020-4e7d-b0b8-f5962922a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:47.800893 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-979e4543-0020-4e7d-b0b8-f5962922a98b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:47.802126 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-979e4543-0020-4e7d-b0b8-f5962922a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:47.809723 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1475/2920] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:47.830424 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:47.841551 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc212f9-d018-400c-a025-9609045e5457 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:47.847553 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:47.848147 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:47.848429 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:47.848704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:47.856636 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:47.858198 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:47.868334 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1446/2921] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:05:50.669831 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aad5f-8675-47b2-af15-706918c1bcfd None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:50.670333 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aad5f-8675-47b2-af15-706918c1bcfd None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:50.670467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aad5f-8675-47b2-af15-706918c1bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:50.691516 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-b98aad5f-8675-47b2-af15-706918c1bcfd None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:50.692780 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-b98aad5f-8675-47b2-af15-706918c1bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:50.700741 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1476/2922] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:50.722528 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:50.733648 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16f0f2-b7f9-48af-ade9-82a914b0572e service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:50.739804 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:50.740416 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:50.740679 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:50.740952 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:50.749089 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:50.751425 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:50.760819 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1447/2923] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:53.892712 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bf36-27ec-4086-a10f-513954844cfa None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:53.893325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bf36-27ec-4086-a10f-513954844cfa None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:53.893325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450bf36-27ec-4086-a10f-513954844cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:53.913107 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-6450bf36-27ec-4086-a10f-513954844cfa None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:53.914361 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-6450bf36-27ec-4086-a10f-513954844cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:53.922128 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1477/2924] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:53.943788 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:53.955265 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0fac3-8238-4110-bbd4-3b596e890d97 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:53.960812 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:53.961405 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:53.961691 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:53.961974 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:53.970318 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:53.971972 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:53.981742 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1448/2925] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:57.129289 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] REQUEST_METHOD: `POST` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:57.129876 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:57.129990 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:57.149423 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.auth.core [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:57.150637 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:57.158235 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1478/2926] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:57.181621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:57.193104 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579bb1-4975-4a62-8440-818545e84f68 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:57.198571 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:57.199165 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:57.199448 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:57.199722 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:57.208090 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:57.209649 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5331ab-226e-484d-b676-13b848ae81c6 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:57.218917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1449/2927] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:06.678969 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:06.689207 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca302f6-5b35-4909-a16d-9037c3337d83 None None] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:06.693672 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:06.694532 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:06.694822 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:06.695094 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:06.696858 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:06.711144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:06.712586 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:06.724411 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1479/2928] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:07.214798 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=73 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:13.155879 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460412b-52e4-4b20-936d-47a8add4ff4e None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:13.156480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460412b-52e4-4b20-936d-47a8add4ff4e None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:13.156480 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460412b-52e4-4b20-936d-47a8add4ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:13.178729 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-f460412b-52e4-4b20-936d-47a8add4ff4e None None] MFA Rules not processed for user `f06afa0292544e81a435a71343da8d73`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:13.179929 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-f460412b-52e4-4b20-936d-47a8add4ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:13.186708 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1450/2929] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 30 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:13.808940 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:13.817498 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=25 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:13.822339 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442a45-2915-4b43-822a-41d5637088e9 service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:13.826438 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507ab70c63db42ffb6c77c02c58d1f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:13.830533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:13.830533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:13.830533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:13.830533 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:13.844837 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:13.846274 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:13.859239 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1480/2930] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:23.172558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=3 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:23.853773 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=5 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:28.504298 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6b94-cfb8-4c4f-b5ab-9a7261b13d15 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:28.504836 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6b94-cfb8-4c4f-b5ab-9a7261b13d15 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:28.504980 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6b94-cfb8-4c4f-b5ab-9a7261b13d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:28.525117 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-bd1c6b94-cfb8-4c4f-b5ab-9a7261b13d15 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:28.526842 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-bd1c6b94-cfb8-4c4f-b5ab-9a7261b13d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:28.534158 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1451/2931] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:28.557127 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:28.569040 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5fcd-ede0-420f-9caa-0bae7fae3b5d service neutron] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:28.574679 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:28.575276 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:28.575558 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:28.575825 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:28.584777 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:28.586335 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:28.595915 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1481/2932] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:06:32.025176 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e689-7f36-4d69-ac45-ce52c935e5a2 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:32.025696 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e689-7f36-4d69-ac45-ce52c935e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:32.025813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e689-7f36-4d69-ac45-ce52c935e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:32.046156 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1cd8e689-7f36-4d69-ac45-ce52c935e5a2 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:32.047451 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1cd8e689-7f36-4d69-ac45-ce52c935e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:32.055488 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1452/2933] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:32.074975 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:32.087220 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196c09-39f3-4d66-9620-6188215a51ee service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:32.092646 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:32.093236 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:32.093517 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:32.093787 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:32.102468 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:32.104060 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:32.113404 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1482/2934] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:34.872706 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239823-a84b-423b-890c-2b34cdba10d8 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:34.877765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239823-a84b-423b-890c-2b34cdba10d8 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:34.877765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33239823-a84b-423b-890c-2b34cdba10d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:34.892587 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-33239823-a84b-423b-890c-2b34cdba10d8 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:34.893813 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-33239823-a84b-423b-890c-2b34cdba10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:34.901815 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1453/2935] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:34.932716 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:34.944201 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483c04-e814-40ff-991e-7280712c1f28 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:34.949569 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:34.950161 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:34.950460 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:34.950733 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:34.959286 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:34.960845 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:34.970087 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1483/2936] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:38.112475 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f528-f449-4731-bf8f-b289f9b7d027 None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:38.113003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f528-f449-4731-bf8f-b289f9b7d027 None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:38.113003 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5f528-f449-4731-bf8f-b289f9b7d027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:38.132512 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-16e5f528-f449-4731-bf8f-b289f9b7d027 None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:38.133704 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-16e5f528-f449-4731-bf8f-b289f9b7d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:38.141557 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1454/2937] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:38.164319 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:38.175467 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988817f1-e28f-4792-96ad-93ebad3ff131 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:38.181013 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:38.181609 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:38.181888 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:38.182159 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:38.190645 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:38.192199 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:38.201501 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1484/2938] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:41.324048 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] REQUEST_METHOD: `POST` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:41.324545 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:41.324677 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:41.344407 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.auth.core [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] MFA Rules not processed for user `0ac9c19be1c04f29b7e3ddf227e2560f`. Rule list: `[]` (Enabled: `True`). {{(pid=93212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:41.345690 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:41.353558 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1455/2939] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Aug 30 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:41.376717 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:41.388300 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb79643-93c4-468b-adaa-954a9cc41d68 service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:41.394356 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:41.394973 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:41.395254 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:41.395523 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:41.404472 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:41.406115 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:41.415537 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1485/2940] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:06:51.083485 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:51.097765 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72816b-a18f-4ec3-b341-0d8a4762904b None None] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:51.107676 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f965f6675e44c3921178931ae00caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:51.108306 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] REQUEST_METHOD: `GET` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:51.108590 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:51.108863 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:51.111818 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.fernet_utils [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:51.124917 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:51.126524 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:51.138256 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1456/2941] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:51.411368 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=30 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:01.133207 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=21 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:12.494431 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:12.504465 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bdbfa-84c5-46eb-ae0e-970a53c5ffab service nova] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:12.509019 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:12.509714 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:12.509996 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:12.510273 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] PATH_INFO: `/v3/users/f06afa0292544e81a435a71343da8d73` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:12.511456 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06afa0292544e81a435a71343da8d73)` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:12.513583 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:12.661689 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06afa0292544e81a435a71343da8d73'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:12.673352 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06afa0292544e81a435a71343da8d73'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:12.678921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06afa0292544e81a435a71343da8d73'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:12.678921 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06afa0292544e81a435a71343da8d73'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:12.739283 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.notifications [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06afa0292544e81a435a71343da8d73'} {{(pid=93213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:12.752292 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1486/2942] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 15:07:12 2022] DELETE /identity/v3/users/f06afa0292544e81a435a71343da8d73 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:12.987514 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] Authenticating user token {{(pid=93212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:12.993421 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aec737-38fe-4775-a32d-09987578b624 service nova] Validating token access rules against request {{(pid=93212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:13.051374 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c19be1c04f29b7e3ddf227e2560f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbef91a083854958a533ab27d1be6c95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:13.052021 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:13.052329 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] SCRIPT_NAME: `/identity` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:13.052596 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] PATH_INFO: `/v3/projects/fbdafec0972c47eb902191c560296a23` {{(pid=93212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:13.053694 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdafec0972c47eb902191c560296a23)` {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:13.055621 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] RBAC: Authorization granted {{(pid=93212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:13.167039 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdafec0972c47eb902191c560296a23', 'request_id': 'req-3c7a9d64-c245-41b8-af71-6b6eaf54032d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:13.236012 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdafec0972c47eb902191c560296a23', 'request_id': 'req-3c7a9d64-c245-41b8-af71-6b6eaf54032d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:13.242370 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdafec0972c47eb902191c560296a23', 'request_id': 'req-3c7a9d64-c245-41b8-af71-6b6eaf54032d'} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:13.253549 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] The token cache is being invalidate because project fbdafec0972c47eb902191c560296a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:07:13.253847 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:13.254498 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG keystone.notifications [None req-3c7a9d64-c245-41b8-af71-6b6eaf54032d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:13.255966 dv-cinder-828806-5-smb devstack@keystone.service[93212]: [pid: 93212|app: 0|req: 1457/2943] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 15:07:12 2022] DELETE /identity/v3/projects/fbdafec0972c47eb902191c560296a23 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:22.748748 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:23.250538 dv-cinder-828806-5-smb devstack@keystone.service[93212]: DEBUG dbcounter [-] [93212] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:24.612952 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Authenticating user token {{(pid=93213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:09:24.614359 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:09:24.684681 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cc3d-e533-47c5-ac8d-ca703b6226ad admin admin] Validating token access rules against request {{(pid=93213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:09:24.743443 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8ff6d1bfd44ec08cef4f0039e1aedc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a4c34a5e4054ee4a2819fab0f36a234', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:09:24.744045 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] REQUEST_METHOD: `GET` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:09:24.744325 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] SCRIPT_NAME: `/identity` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:09:24.744598 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:09:24.748160 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.fernet_utils [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:09:24.759868 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:09:24.761513 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80ab9c-99e8-47f3-8b88-dbf9d7404b58 service placement] RBAC: Authorization granted {{(pid=93213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:09:24.772144 dv-cinder-828806-5-smb devstack@keystone.service[93213]: [pid: 93213|app: 0|req: 1487/2944] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 30 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:09:34.767708 dv-cinder-828806-5-smb devstack@keystone.service[93213]: DEBUG dbcounter [-] [93213] Writing DB stats keystone:SELECT=58 {{(pid=93213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}